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ABSTRACT 


The  Profile  Measuring  Device  (PMD)  was  developed  at  the  George  C.  Marshall 
Space  Flight  Center  following  the  loss  of  the  Space  Shuttle  Challenger.  It  is 
a rotating  gauge  used  to  measure  the  absolute  diameters  of  mating  features  of 
redesigned  Solid  Rocket  Motor  (SRM)  field  joints.  Diameter  tolerances  of 
these  features  are  typically  ±0.005  inches  and  it  is  required  that  the  PMD 
absolute  measurement  uncertainty  be  within  this  tolerance.  In  this  analysis 
we  find  the  absolute  accuracy  of  these  measurements  to  be  ±0.00375  inches, 
worst  case,  with  a potential  accuracy  of  ±0.0021  inches  achievable  by  improved 
temperature  control. 
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1 . INTRODUCTION 


In  this  document  we  present  error  estimates  for  the  absolute  accuracy 
of  part  diameters  measured  with  the  Profile  Measuring  Device  (PMD), 
developed  at  the  Marshall  Space  Flight  Center  (MSFC) . The  PMD  is  used 
to  measure  the  relevant  geometry  of  the  mating  surfaces  of  the  Space 
Shuttle  Solid  Rocket  Motors  (SRMs) . This  analysis  applies  specifically 
to  PMD  Serial  Numbers  002  and  003,  which  are  mechanically  more  robust 
versions  of  the  prototype  S/N  001  and  which  employ  an  absolute  radius 
mastering  fixture  of  simple  geometry.  A sketch  of  the  PMD  system  is 
shown  in  Figure  1 . 

As  will  be  shown,  the  uncertainties  in  absolute  dimensions  determined  by 
the  PMD  are  strongly  coupled  to  the  various  thermal  environments 
encountered  during  the  calibration  and  part  measurement  processes.  By 
international  agreement  the  dimensions  of  mechanical  objects  are  those 
which  exist  at  a uniform  temperature  of  68°F  (20°C).  Ideally,  all 
precision  dimensional  metrology  should  be  performed  at  this  temperature. 
When  this  is  not  possible,  for  reasons  of  convenience  and/or  cost,  there 
is  a price  to  be  paid  in  measurement  uncertainty.  At  some  point, 
thermal  errors  will  equal  or  exceed  the  entire  working  tolerance  of  the 
part  being  measured.  When  this  occurs,  the  only  logical  choices  are  to 
improve  the  thermal  environment  or  to  relax  the  working  tolerances. 

As  a guide  to  understanding  the  effects  of  temperature  variations  in 
dimensional  metrology,  we  include  as  Appendix  A a copy  of  ANSI  Standard 
B89 . 6 . 2- 1973 , "Temperature  and  Humidity  Environment  for  Dimensional 
Measurement . " 


2 . TECHNICAL  APPROACH 


We  have  divided  the  PMD  error  analysis  into  a sequence  of  steps  based 
upon  the  way  the  device  is  used  in  practice.  A typical  part  measurement 
cycle  proceeds  as  follows: 

1)  CALIBRATION 

The  absolute  radius  of  the  PMD  , radial  arm  is  determined  by 
comparison  with  a wavelength-compensated  laser  interferometer 
system.  This  mastering  is  performed  for  each  of  the 
interchangeable  measuring  tips  and  occurs  in  some 
approximately  known  set  of  environmental  conditions.  In 
particular,  the  average  temperature  of  the  radial  arm  during 
calibration  is  estimated  to  be  T^^-  , based  upon  measurement  at 
one  radial  location. 

2)  MEASUREMENT 

SRM  tang  and/or  clevis  features  are  measured.  During  this 
process,  the  PMD  tips  are  changed  in  order  to  access  ail  of 
the  relevant  features.  These  measurements  are  performed  in 


1 


2 


some  (generally  different)  set  of  approximately  known 
environmental  conditions.  The  part  temperature  is  measured  at 
four  circumferential  locations,  and  the  average  part 
temperature  is  assigned  an  estimated  value  of  . The 

average  temperature  of  the  radial  arm  is  estimated  to  be  T^„  , 
based  upon  measurement  at  one  radial  location.  The  difference 
Tam”Tj^c  used  to  correct  the  radial  data  for  thermal 

expansion  of  the  radial  arm. 

3)  ANALYSIS 

The  measured  set  of  polar  coordinate  data  pairs  is 

reduced  by  a software  analysis  routine  to  yield  the  part 
dimensions  of  interest.  The  routine  proceeds  by  first 
removing  the  PMD  centering  error  using  a least- squares  fit  to 
a circle.  Then,  the  feature  perimeter  is  estimated  by  summing 
the  chords  connecting  adjacent  points  and  multiplying  the  sum 
by  a constant.  This  constant  (1.000012693)  is  the  ratio  of 
the  circumference  of  a circle  to  the  perimeter  of  a 360-sided 
inscribed  polygon.  Finally,  the  feature  diameter  is 

calculated  by  dividing  the  perimeter  by  ir . 

4)  EXTRAPOLATION  TO  68 °F 

Part  feature  dimensions  are  extrapolated  to  68°F  using  a 
thermal  expansion  calculation  and  the  temperature  difference 
Tp„-68“F. 

An  examination  of  this  measurement  sequence  suggests  a way  to 
decompose  the  PMD  error  analysis  into  a set  of  plausibly 
uncorrelated  components  which  can  be  individually  estimated 
and  then  combined  in  quadrature.  We  have  chosen  the  following 
error  components : 

1)  CALIBRATION  ERROR 

Error  associated  with  the  mastering  process. 

Diameter  error  = AD^-^l  • 

2)  MECHANICAL  ERROR 

Error  contribution  from  the  geometry  and  moving 
elements  of  the  PMD. 

Diameter  error  = ADf,,j.f;fj  . 

3)  THERMAL  ERROR 


Errors  in  thermal  expansion  calculations. 
Diameter  error  = AD^gj-p,^. 
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4)  SOFTWARE  ERROR 


Error  introduced  in  the  analysis  algorithms. 

Diameter  error  = AD30FT • 

In  estimating  the  contributions  to  the  total  PMD  measurement 
error  from  the  individual  error  sources,  we  are  guided  by  the 
work  of  R.R.  Donaldson,  who  first  developed  a systematic 
approach  to  error  budgeting  for  precision  machines  (see 
Appendix  B) . 

The  first  step  involves  estimating  the  peak- to-valley  (PV) 
error  amplitudes  associated  with  each  individual  error  source. 
In  some  instances  this  can  be  done  by  a reasonably 
straightfoirward  calculation.  In  most  cases,  however,  these 
error  amplitudes  are  plausible  estimates  guided  by  experience 
and  by  comparison  with  the  known  behavior  of  other  precision 
machines.  The  most  important  requirement  in  this  process  is 
to  analyze  the  system  at  a sufficient  level  of  detail  so  that 
potentially  significant  sources  of  error  are  not  inadvertently 
omitted . 


Once  the  error  amplitudes  are  assigned,  they  must  be  combined 
to  yield  a composite  error  using  a combinatorial  rule.  There 
is  no  known  rigorously  correct  way  to  do  this  for  mechanical 
systems  since  the  detailed  contributions  and  correlations  of 
the  individual  errors  are  not  known  a priori.  A worst-case 
estimate  can  be  arrived  at  by  simply  adding  all  PV  amplitudes 
together,  but  this  is  conservative  in  the  extreme  since  it  is 
highly  unlikely  that  all  sources  of  error  will  be 
simultaneously  at  a maximum  and  in  the  same  direction. 


Another  method  of  error  combination,  as  suggested  by 
Donaldson,  is  to  compute  a total  RMS  error  from  individual  RMS 
contributions  according  to: 


RMS 


TOTAL 


(RMSJ2 


(1) 


where  the  relation 

PV^  = K j RMS^  (2) 

relates  the  RMS  amplitudes  to  the  corresponding  PV  values. 

The  constant  K depends  upon  the  probability  distribution  of 
the  individual  errors  which,  again,  is  not  generally  known.  A 
reasonably  conservative  approach  is  to  use  a uniform 
distribution  of  the  individual  errors,  in  which  case 
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K = 273  = 3.46  and  Equation  (1)  becomes 


R^Stot AL 


1 

273 


(3) 


Because  Equation  (3)  negiects  any  possible  error  correlations, 
there  will  be  a tendency  to  underestimate  the  total  error. 

In  light  of  these  observations,  we  have  adopted  an  approach 
which  has  recently  been  used  in  the  Precision  Engineering 
Program  at  Lawrence  Livermore  National  Laboratory  in  the 
design  error  budget  for  a new,  high-accuracy  measuring  machine 
for  the  Department  of  Energy.  Here,  we  estimate  the  composite 
error  by  averaging  the  (over-conservative)  sum  of  PV  errors 
and  the  (under- conservative)  RMS  result: 


where 


RMS.JOTAL  ^^TOTAL 


PV 


TOTAL 


PV, 


(4) 


(5) 


Lacking  any  more  rigorous  theoretical  guidance,  we  believe 
that  this  approach  will  yield  a plausible  estimate  of  PMD 
absolute  accuracy. 

The  estimated  diameter  errors  are  then  calculated  for  each  of 
the  four  error  components:  calibration,  mechanical,  thermal, 
and  software.  Since  we  believe  these  components  to  be 
uncorrelated , the  estimated  system  error  is  then  calculated  by 
quadrature : 


AD 


TOTAL 


(ADjjj  )^  + (ADgQp-j.) 


% 
2 


(6) 


Equation  (6) 
procedure . 
components . 


represents  the  central  result  of  our  estimation 
We  now  proceed  to  develop  the  detailed  error 
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3. 


CALIBRATION  ERROR 


The  absolute  radius  of  the  PMD  is  determined  using  a calibration  fixture 
consisting  of  a laser  interferometer  system  and  a precision  inspection 
block.  The  vacuum  wavelength  of  the  laser  is  measured  by  the 
manufacturer  by  frequency  comparison  with  an  iodine-stabilized  He-Ne 
laser.  The  latter  is  an  internationally  recognized  transfer  standard  of 
length  which  realizes  the  definition  of  the  meter  with  an  uncertainty  of 
approximately  1 part  in  10^°. 

Measurement  errors  associated  with  the  calibration  process  consist  of 
interferometer  errors  and  mechanical  errors.  Interferometer  errors  are 
length- dependent  and  are  calculated  assuming  a nominal  measured 
displacement  of  144  inches. 

The  vacuum  wavelength  of  the  metrology  laser  is  known,  by  frequency 
comparison,  to  1 part  in  10^  or  better  [displacement  uncertainty  = 0.1 
parts  per  million  (ppm)].  It  is  necessary  to  correct  the  vacuum 
wavelength  for  the  refractive  index  of  air  during  calibration.  This 
correction  is  primarily  determined  by  air  pressure,  temperature,  and 
relative  humidity.  Based  upon  witnessed  calibrations  and  an  examination 
of  the  methods  used  to  determine  the  environmental  variables,  we 
estimate  the  following  systematic  errors:  (a)  pressure  uncertainty  = 
0.1  in  Hg;  (b)  temperature  uncertainty  = 2'’F;  (c)  humidity 
uncertainty  = 10%  RH.  The  respective  error  contributions  are  1 ppm 

(pressure),  1 ppm  (temperature),  and  0.1  ppm  (humidity). 

The  refractive  index  of  air  is  also  affected  by  changes  in  composition, 
particularly  those  due  to  carbon  dioxide  and  organic  solvents.  We 
conservatively  estimate  an  error  of  1 ppm  associated  with  composition 
uncertainty  in  the  current  calibration  environment  at  Clearfield. 

If  the  metrology  laser  beam  is  not  aligned  with  the  axis  of  travel  of 
the  calibration  fixture  slider,  the  measured  travel  will  be  too  small  by 
an  amount  proportional  to  the  cosine  of  the  angular  misalignment.  The 
resultant  error  is  called  cosine  error.  By  careful  alignment,  cosine 
error  can  be  made  as  small  as  desired.  A worst-case  estimate  for  the 
PMD  calibration  fixture,  corresponding  to  1/16  inch  beam  offset  in  144 
inches  of  travel  results  in  0 . 1 ppm  cosine  error. 

We  now  turn  to  calibration-related  mechanical  errors,  beginning  with  the 
PMD  rotation  axis.  The  radial  arm  is  mounted  to  a central  shaft  guided 
by  a pair  of  annular  contact  bearings.  The  two  bearings  are  pre-loaded 
and  separated  by  approximately  4 inches.  Any  radial  motion,  or 
"runout,"  of  this  bearing  ^system  will  cause  a one-for-one  error  in 
radius  calibration.  We  have  estimated  this  radial  error  motion  to  be  20 
iwLcroinches  PV,  which  is  the  range  of  errors  observed  in  precision 
machine  spindles  using  ball  bearings.  The  worst-case  diameter  error  is 
then  40  microinches. 
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If  the  radial  errors  of  the  spindle  bearings  are  not  in  phase,  then 
there  will  be  a tilt  error  motion  inversely  proportional  to  the  bearing 
separation.  Assuming  a 20  microinch  radial  motion  for  each  bearing  and 
a 4 inch  separation  yields  a tilt  motion  of  10  microradians  or  about  2 
arc-seconds.  The  actual  radial  error  at  the  measuring  tip  depends  upon 
the  axial  offset  of  the  tip  from  the  center  of  rotation  of  the  bearing 
system.  Taking  6 inches  as  a typical  offset  yields  a radial  error  due 
to  tilt  motion  of  6 inches  x 10  microinches/inch  = 60  microinches,  or  a 
diameter  error  of  120  microinches. 

We  estimate  a diametral  error  of  40  microinches  due  to  radial  motion  and 
shape  error  of  the  measuring  tip  contact  bearing.  Length  calibration 
data  for  the  inspection  block,  according  to  MSFC  personnel,  show  a 
length  uncertainty  of  -0/+200  micro inches.  We  assume  a least-count 
error  in  reading  the  digital  linear  gauge  at  each  end  of  the  calibration 
process,  yielding  a diameter  error  of  200  microinches. 

In  this  analysis  we  have  assumed  that  the  horizontal  and  vertical  ball 
slides  at  the  end  of  the  PMD  radial  arm  are  in  the  same  locations  at 
each  end  of  travel  in  the  calibration  process.  Should  this  not  be  the 
case,  errors  contributed  by  these  slides  would  have  to  be  included  in 
the  calibration  error  budget.  These  errors  are  discussed  in  the  section 
on  mechanical  errors . 

We  have  also  assumed  negligible  error  due  to  lack  of  squareness  between 
the  spindle  rotation  axis  and  the  line  of  motion  of  the  calibration 
fixture  slider.  The  fixture  is  carefully  adjusted  during  calibration  so 
that  the  tip  contacts  the  inspection  block  at  the  same  height  at  both 
ends  of  travel.  if  these  heights  were  to  differ  by  0.05  inches,  the 
resultant  diameter  error  would  be  about  10  microinches. 

Finally,  we  assume  here  that  the  tip  contact  forces  during  calibration 
are  negligibly  different  from  those  encountered  during  part  measurement, 
so  that  tip  deflections  are  constant  and  are  included  in  the  values  of 
the  calibrated  radii. 

The  PMD  measuring  tips  are  bolted  into  place,  with  no  attempt  to  make 
their  locations  kinematically  determinate.  Furthermore,  we  are  not 
aware  of  any  torque  specifications  in  the  tip  mounting  procedures.  We 
estimate  that  each  tip  can  be  removed  and  re-mounted  with  a radial 
uncertainty  of  100  microinches,  leading  to  a diameter  error  of  200 
microinches . 

The  calibration  error  budget  is  shown  in  Table  1.  Combining  the 
individual  errors  according  to  Equation  (4)  yields  = ±702 
microinches . 
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TABLE  1. 


CALIBRATION  ERROR  BUDGET 


Error  Source 

Peak- to -Valley 

Diameter  Error 
(microinches) 

1 . Laser  Interferometer 

a . 

Vacuum  Wavelength  (0.1  ppm) 

14.4 

b. 

Pressure  Error  (1  ppm) 

144.0 

c . 

Temperature  Error  (1  ppm) 

144.0 

d. 

Humidity  Error  (0.1  ppm) 

14.4 

e . 

Air  Composition  (1  ppm) 

144.0 

f . 

Cosine  Error  (0.1  ppm) 

14.4 

2.  Mechanical  Factors 

a . 

Spindle  radial  motion 

40.0 

b. 

Spindle  tilt  motion 

120.0 

c . 

Tip  bearing  errors 

40.0 

d. 

Tip  mounting  repeatability 

200.0 

e . 

Inspection  block  calibration 

200.0 

f . 

Linear  gauge  least  count 

200.0 

PV 

TOTAL  — 1275  /ixn. 

RMStotal  (Eq.  3)  = 129  ^in. 

^Dcal  = ±702  Min. 
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4. 


MECHANICAL  ERROR 


The  mechanical  error  budget  includes  those  error  components  associated 
with  the  geometry  and  moving  elements  of  the  PMD.  Spindle  errors,  tip 
bearing  errors,  and  tip  mounting  repeatability  have  been  discussed  in 
the  context  of  calibration  errors  and  they  also  contribute  to  errors 
during  measurement. 

Radial  deviations  are  measured  using  a digital  linear  gauge  with 
100  microinch  resolution.  Specifications  provided  by  MSEC  do  not  state 
the  accuracy  of  this  gauge,  but  experience  with  similar  devices  at  the 
National  Institute  of  Standards  and  Technology  (NIST)  suggests  an 
absolute  accuracy  of  approximately  200  microinches  per  inch  of  travel. 
With  this  estimate  of  gauge  accuracy  the  diameter  error  is  400 
microinches,  asstoming  a total  travel  of  one  inch  during  part 
measurement . 

The  linear  gauge/bail  slide/measuring  tip  assembly  of  the  PMD  is 
characterized  by  what  is  called  an  Abb6  offset.  This  means  that  the 
linear  gauge  is  not  in  line  with  the  displacement  to  be  measured,  i.e., 
the  radial  motion  of  the  measuring  tip.  Because  of  this  offset,  any 
angular  motion  (pitch)  of  the  horizontal  ball  slide  as  it  translates 
will  cause  a radial  error.  The  magnitude  of  the  error  is  simply  the 
offset  distance  times  the  slide  pitch  error  motion.  The  offset  distance 
depends  upon  which  tip  is  being  used,  with  a maximum  value  of  about 
8 inches.  The  pitch  motion  of  the  horizontal  slide  is  not  specified  in 
the  data  sheet  supplied  by  MSEC  but  may  be  estimated  to  be  5 arc-seconds 
in  one  inch  of  travel,  a value  typical  of  precision  ball  slides.  Using 
these  values , we  estimate  the  radial  error  contribution  to  be 
8 inches  x 5 arc-seconds  x 5 microinches/inch/arc-second  or  200 
microinches,  with  a corresponding  diameter  error  of  400  microinches. 

Straightness  error  motions  of  the  vertical  ball  slide  cause  one-for-one 
errors  in  radial  data.  The  data  sheets  for  this  slide  specify  a 
straight  line  accuracy  of  500  microinches  per  inch  of  travel.  Assuming 
1/2  inch  of  travel  during  a part  measurement  implies  a possible  radial 
error  of  250  microinches  or  500  microinches  diameter  error. 

If  the  vertical  ball  slide  is  not  mounted  orthogonally  to  the  horizontal 
slide,  then  motion  of  the  vertical  slide  will  contain  a component  in  the 
radial  direction.  Estimating  a squareness  error  of  20  arc-seconds  and 
1/2  inch  of  travel  yields  a radial  error  of  1/2  inch  x 20  arc-seconds  x 
5 microinches/inch/arc  - second  = 50  microinches  radial  error,  100 
microinches  on  diameter. 

PMD  radial  error  is  also  sensitive  to  angular  motion  of  the  vertical 
ball  slide.  If  the  slide  rotates,  or  pitches,  the  measuring  tip  will 
move  radially  by  an  amount  equal  to  the  tip  length  times  the  pitch 
angle.  Eor  a pitch  of  2.5  arc-seconds  in  1/2  inch  of  travel,  and  a 6 
inch  tip,  the  error  is  6 inches  x 2.5  arc-seconds  x 5 
microinches/inch/arc-second  = 45  microinches  radial  error,  90 
microinches  on  diameter. 
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The  estimated  mechanical  error  budget  is  shown  in  Table  2.  Combining 
the  individual  errors  according  to  Equation  (4)  yields  = ±1061 
microinches . 


5 . THERMAL  ERROR 


The  coefficient  of  thermal  expansion  of  an  engineering  material  is 
defined  by 


dL/L 

a(T)  = , (7) 

dT 


where  dL/L  is  the  fractional  change  in  a characteristic  linear  dimension 
and  dT  is  the  change  in  temperature.  If  a sample  has  length  Lq  at 
temperature  Tq  , then  the  length  L at  the  temperature  T is  found  by 
integrating  Equation  (7): 


L = Lq  exp 


T 

Ja(T)dT 

Tn 


(8) 


In  common  engineering  practice  a(T)  is  approximated  by  its  average  value 
a over  the  temperature  range  T-Tq , so  that  Equation  (8)  becomes 


L = Lq  exp 


5(T-To) 


(9) 


The  range  of  temperatures  encountered  in  dimensional  metrology  is  nearly 
always  such  that  5(T-Tq)«1,  so  that  Equation  (9)  may  be  written 


L = Lq 


1 + a(T-To) 


(10) 


Equation  (10)  is  the  standard  expression  used  to  correct  dimensional 
measurements  for  the  effects  of  thermal  expansion.  [Note:  we  have 

replaced  a by  a for  simplicity.] 
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TABLE  2. 


MECHANICAL  ERROR  BUDGET 


Peak- to -Valley 

Error  Source  Diameter  Error 

(microinches) 


1. 

Spindle  radial  motion 

40.0 

2. 

Spindle  tilt  motion 

120.0 

3. 

Linear  gauge  accuracy 

400.0 

4. 

Horizontal  slide  pitch 

400.0 

5. 

Vertical  slide  straightness 

500.0 

6. 

Vertical  slide  pitch 

90.0 

7. 

H-V  slide  squareness 

100.0 

8. 

Tip  bearing  errors 

40.0 

9. 

Tip  mounting  repeatability 

200.0 

P^TOTAL  = 1890  flin.  f^SxoTAL  (Eq.  3)  = 232  ^in. 


AD|yjECH~~  — 1061  ^xn. 
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For  measurements  that  demand  a very  high  degree  of  accuracy,  it  is 
important  to  realize  that  the  arguments  of  Equation  (10)  may  not  be 
known  exactly.  Taking  the  differential  of  both  sides  yields 

5L  = aLo5(T-To)  + Lo(T-To)5q 


— oLn 


5(T-To)  + (6a/a)(T-To) 


— Q Ln 


5T-5To  + (5q/q)(T-To) 


(11) 


Here,  (ST  and  (STq  are  temperature  uncertainties  and  Sa  is  the  uncertainty 
in  the  coefficient  of  thermal  expansion.  Since  the  signs  of  the 
uncertainties  are  generally  unknown,  the  maximum  error  in  estimated 
length  is  found  by  re-writing  Equation  (11)  using  absolute  values: 


^IriAX  ~ 


5T1  + |5To  1 + (5a/a) |T-To  1 


(12) 


The  quantity  Sa/a  is  the  fractional  uncertainty  in  the  nominal 
coefficient  of  thermal  expansion.  It  is  rarely  encountered  in 
dimensional  metrology  but  it  becomes  significantly  important  for  large 
parts  (large  oLq ) and  for  large  temperature  extrapolations  (large 
|T-Tg|).  The  consequences  of  this  uncertainty  are  emphasized  in  Section 
20.2  of  ANSI  Standard  B89.6.2  (Appendix  A). 

Thermal  expansion  corrections  for  PMD  measurement  data  employ  two 
coefficients:  (a)  for  the  radial  arm,  = 13  ppm/°F  (6061-T6 

aluminum  alloy)  and  (b)  for  the  part,  = 6.8  ppra/°F  (steelj.  The 

uncertainties  in  these  coefficients  are  not  known;  they  are  estimated 
here  to  be  5%  of  the  nominal  values.  That  is 

^“arm/'^arm  ~ '5°^part/'^part  ~ 0.05.  (13) 

Based  upon  ANSI  B89.6.2  these  estimates  are  reasonable,  and,  in  the  case 
of  the  radial  arm,  may  be  somewhat  optimistic.  A brief  survey  of 
engineering  material  reference  data  on  6061 -T6  wrought  aluminum  alloy 
found  values  of  the  expansion  coefficient  ranging  from  12  ppm/°F  [ALCOA 
Structural  Handbook]  to  13.5  ppm/°F  [Standard  Handbook  for  Mechanical 
Engineers].  Perhaps  the  definitive  reference  work  is  Volume  12  of  the 
Thermophysical  Properties  of  Matter,  "Thermal  Expansion  of  Metallic 
Elements  and  Alloys,"  which  gives  a value  of  a for  6061-T6  alloy  of 
12.5  ppm/°F  at  20°C  (68°F),  with  an  explicit  statement  of  a ±7% 
uncertainty  in  thermal  expansion  data  on  this  alloy. 

Case  diameter  data  from  the  PMD  involves  two  thermal  expansion 
calculations.  Radial  data  is  corrected  for  expansion  (or  contraction) 
of  the  radial  arm  between  the  calibration  temperature  (Ty,^^  ) and  the  arm 
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temperature  during  measurement  Then,  the  part  dimensional  data 

is  extrapolated  from  the  part  temperature  during  measurement  (Tp,,,)  to 
68°F.  These  calculations  employ  the  standard  expression,  Equation  (10), 
using  nominal  values  for  the  expansion  coefficients.  The  uncertainties 
in  the  calculations  can  now  be  estimated  using  Equation  (12)  and 
Equation  (13).  We  write  for  the  two  uncertainties: 

T 

^^ARM  “ diameter  error  due  to  arm  thermal  expansion  uncertainty 

T 

ADpART  = diameter  error  due  to  part  thermal  expansion  uncertainty. 
Using  Equations  (12)  and  (13)  gives 


T 


AD 


ARM 


+ |5Ta„1  + 0.05 


and 


T 

ADpARx 


“PART^NOM 


+ 0.05|Tp„-68| 


(14a) 


(14b) 


Here,  Dj^q^  is  a nominal  part  feature  diameter,  taken  to  be  144  inches. 
Using  the  nominal  values  of  (13  ppm/°F)  and  Op^^pp  (6.8  ppm/’F),  we 
have 


41^arm  ~ 1872 


Q«T,c 


5T 


AM 


+ 0.05  |T^f^-Ty^(. 


(15a) 


40pART  ~ 


5TpM I + 0.05  |Tp„-68| 


(15b) 


In  these  expressions  the  temperature  units  are°F  and  the  diameter  errors 
are  given  in  microinches. 

Once  the  various  thermal  environments  are  known  (or  at  least  estimated) , 
the  total  system  error  due  to  thermal  effects  can  be . calculated  from 
Equations  (15a-b).  The  two  expressions  are  PV  estimates  of  separate 
thermal  error  components.  The  total  thermal  error  is  then 
calculated  using  Equations  (4)  and  (5). 

Because  of  the  very  wide  range  of  thermal  environments  found  at 
Clearfield,  there  is  clearly  no  unique  value  for  the  measurement  thermal 
error.  We  therefore  proceed  to  calculate  the  thermal  error  for  a range 
of  temperatures  typical  of  the  current  environment.  We  will  also 
analyze  a "best-case"  situation  assuming  that  the  entire  PMD  measurement 
process  takes  place  in  a thermal  environment  similar  to  that  found  in  a 
standards  laboratory. 

We  first  consider  three  thermal  environments  at  nominal  average 
temperatures  of  68,  78,  and  88°F.  The  20°F  range  of  temperatures  is 
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representative  of  the  range  actually  experienced  at  Clearfield  during 
PMD  measurement  testing.  The  PMD  radial  arm  and  the  measured  parts  have 
temperature  sensors  used  for  data  correction  during  calibration  and 
measurement.  While  these  sensors  have  been  calibrated  at  MSFC,  in  order 
to  account  for  calibration  errors,  drift,  linearity  errors,  and  unknown 
temperature  gradients,  we  assume  an  uncertainty  5T  of  1“F  (PV)  for  the 
average  arm  and  part  temperatures.  That  is: 

= «Tp„  = ±0.5-F 

We  now  proceed  to  calculate  the  thermal  error  estimates.  Recall  that 
the  PMD  is  calibrated  at  a nominal  temperature  of  T^^-  and  that  the  part 
is  measured  with  the  arm  at  temperature  T^^  and  the  part  at  temperature 
Tpf,,  . The  quantities  T^(-  , , and  Tp^  can  assume  any  of  the  three 

chosen  temperature  values,  although  we  expect  that  the  PMD  and  the  part 
are  in  thermal  equilibrium  during  a measurement,  so  that  T^^  = Tp,..,  . 
There  are  three  special  cases  to  consider: 

(a)  T^j;  = T^f.,  . If  the  temperature  is  nominally 

unchanged  through  a calibration/measurement  cycle, 
then  no  thermal  expansion  correction  is  applied  to 
the  PMD  radial  arm.  Because  of  the  ±0 . 5 ° F 

temperature  tolerance,  however,  the  two  temperatures 
may  differ  by  as  much  as  1°F.  In  this  case  AD^p^  is 
calculated  using  Equation  (10)  with  T-Tq  = 1°F, 

a = Qiarm  > ^rid  Lq  = Df^Q^  = 144  inches. 

(b)  Tp,.^  = SS^F.  If  the  part  is  measured  at  a nominal 

temperature  of  68°F,  then  no  part  temperature 
correction  is  applied.  Because  of  the  ±0.5°F 

temperature  tolerance,  however,  the  actual  part 
temperature  may  differ  from  68°F  by  as  much  as 
0.5'’F.  In  this  case  ADp^p^  is  calculated  using 
Equation  (10)  with  T-Tq  = 0.5°F,  a = ap^^-,  and 

Lq  - Orom  = inches. 

(c)  In  ail  other  situations  the  thermal  errors  are 

calculated  using  Equations  (15a-b). 

Table  3 displays,  in  matrix  form,  the  range  of  estimated  total  thermal 
error.  We  see  that  this  error  can  be  less  than  0.0015  inches  when  gauge 
calibration  and  part  measurement  are  carried  out  at  68°F  with  reasonable 
control  (±0.5°F).  On  the  other  hand,  the  error  is  more  than  0.003 
inches  if  the  gauge  is  calibrated  at  68°F  and  the  measurement  is  done  at 
88“F. 

As  a "best-case"  scenario,  if  the  calibration  and  measurement  process 
could  be  performed  in  a thermal  environment  of  68±0.2°F  (typical  of  a 
dimensional  metrology  laboratory) , then  the  system  thermal  error  would 
be  less  than  0.0007  inches. 
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TABLE  3 


THERMAL  ERROR  MATRIX 


Measurement 
Temperature 
’ '^PM 

(“F) 


Calibration  Temperature,  T^j.  (°F) 


6810.5 

7810.5 

8810.5 

68±0.5 

±1461 

±2061 

±2663 

78±0.5 

±2323 

±1730 

±2323 

88±0.5 

±3188 

±2597 

±2104 

Table  entries  are  estimated  thermal  error  in 
units  of  microinches.  The  method  of  calculation  is 
explained  in  the  text. 


NOTE : If  T^(-  = T^^.,  = Tpf.,  = 68±0.2°F,  then  = 693  microinches. 
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6. 


SOFTWARE  ERROR 


The  PMD  analysis  software  uses  a simple  chord  algorithm  to  compute  the 
perimeters  of  measured  SRM  features.  The  input  data  set  of  polar 

coordinate  data  pairs  is  first  fit  to  a least-squares  circle  and  the 
points  re-expressed  in  a polar  coordinate  system  with  its  origin  at  the 
center  of  this  circle.  This  is  mathematically  equivalent  to  removing 
the  first  harmonic  term  in  a Fourier  series  and  has  the  effect  of 

removing  the  PMD  centering  error. 

It  should  be  noted  that  the  data  centering  fit  is  performed 

independently  for  each  measured  feature,  so  that  the  PMD  does  not 

measure  the  complete  joint  geometry  in  a fixed  coordinate  system.  If 
two  SRM  joint  features  were  perfectly  circular  but  eccentric,  the 
eccentricity  would  not  be  detected.  Because  of  the  way  in  which  the  SRM 
cases  are  manufactured  this  is  probably  not  a problem,  but  the  effect 
should  be  recognized. 

Part  diameters  computed  using  the  MSFC  algorithm  have  been  shown  to  be 
insensitive  to  PMD  gauge  centering.  In  one  witnessed  test,  the  gauge 
was  deliberately  de-centered  by  0.25  inches  and  the  measured  feature 
diameter  repeated  to  100  microinches. 

We  have  performed  extensive  testing  of  the  MSFC  chord  algorithm,  using 
computer-generated  simulated  case  data  as  well  as  actual  hardware 
measurement  data  supplied  by  MSFC  personnel.  Computed  diameters  using 
the  chord  algorithm  were  also  compared  with  those  determined  by  a 
variety  of  other  curve  fitting  algorithms,  including  least-squares 
circles,  linear  arcs,  blended  smoothing  polynomials,  cubic  B-splines, 
and  global  fitting  to  Fourier  series  up  to  the  16th  harmonic  in  5 . In 
addition  to  these  tests  we  also  examined  the  effects  of  resolver  angular 
errors  and  radial  noise  (random  radial  errors)  on  the  fit  results.  We 
summarize  these  tests  below. 

We  first  tested  the  chord  algorithm  using  computer-generated  data 
representing  an  ellipse  with  a semi-major  axis  of  74  inches  and  a serai- 
minor  axis  of  70  inches.  The  perimeter  of  this  simulated  case  can  be 
calculated  to  any  required  precision  using  high-accuracy  numerical 
integration.  The  test  data  set  had  3600  points,  so  that  the  numerical 
correction  factor  of  1.000012693  was  changed  to  1.00000012693.  In  this 
test,  the  chord  algorithm  yielded  the  perimeter  with  an  error  of  less 
than  1 microinch.  The  actual  numbers  are  (a)  exact  result  (to  9 
significant  figures):  452.476613  inches;  (b)  MSFC  chord  algorithm: 

452.4766124  inches.  For  comparison  purposes  we  note  that  the  perimeter 
of  the  best-fit  circle  is  452.563841  inches,  which  is  too  large  by 
0.087  inches.  The  diameter  of  this  circle  is  approximately  0.014  inches 
larger  than  that  of  the  circle  obtained  by  "rounding"  the  elliptical 
case . 

We  then  compared  the  chord  algorithm  with  a range  of  other  techniques 
for  perimeter  estimation,  using  actual  SRM  case  measurement  data  (MSFC 
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data  file  07248709.49).  This  was  a clevis  feature  using  PMD  tip  #5.  In 
our  opinion,  the  most  accurate  of  these  algorithms  is  a global  Fourier 
series  fit  to  the  data  with  terms  included  up  to  the  16th  harmonic.  The 
results  of  this  comparison  are  as  follows: 

Algorithm  Perimeter  (inches)  Diameter  (inches') 


16th-harmonic  Fourier 
MSFC  chord  summation 
B-spline  smoothing 
Linear  arcs 
Least-squares  circle 


454.242822 

454.242851 

454.242839 

454.242795 

454.240667 


144.589981 

144.589990 

144.589986 

144.589972 

144.589295 


The  difference  in  mean  diameter  between  the  MSFC  algorithm  and  the 
Fourier  expansion  fit  is  seen  to  be  only  9 microinches.  We  also  note 
that  the  least-squares  circle  result,  while  reasonably  good  in  absolute 
terms,  is  the  least  accurate  of  the  algorithms.  This  has  been  found  to 
be  generally  true,  particularly  as  actual  case  features  depart 
substantially  from  circular,  because  of  the  averaging  nature  of  the 
circular  fit. 


The  next  test  was  designed  to  examine  the  effects  of  random  radial 
errors  on  the  calculated  feature  diameters.  The  size  and  distribution 
of  random  errors  in  real  PMD  data  is  not  known,  but  an  examination  of 
the  raw  data  from  repeated  runs  suggests  a level  of  200-300  microinches. 
For  this  numerical  experiment  the  PMD  data  from  the  previous  comparison 
was  artificially  corrupted  by  the  addition  of  a uniform  distribution  of 
random  "noise"  to  the  radial  data.  We  then  computed  the  mean  feature 
diameter  using  the  chord  algorithm.  The  results,  for  various  levels  of 
noise,  are  as  follows  (average  of  10  trials  for  each  noise  level): 


Radial  Noise 

( inches') 

0 

±0.001 

±0.002 

±0.003 

±0.004 


Mean  Diameter 

( inches ) 

144.589990 

144.590039 

144.590070 

144.590251 

144.590515 


Delta  Diameter 

( inches ) 

0 

+0.000049 

+0.000080 

+0.000261 

+0.000525 


It  is  clear  from  these  results  that  the  MSFC  chord  algorithm  is 
insensitive  to  any  plausible  level  of  random  radial  error  in  the  PMD 
data . 


As  a final  test  of  the  analysis  software,  we  examined  the  effects  of 
angular  errors  in  the  data.  _ The  existence  of  such  errors  was  suggested 
by  calibration  data  on  the  resolver  of  PMD  S/N  002.  This  data  showed  a 
second-harmonic  angle  error  with  an  amplitude  of  approximately  ±0.25 
degrees.  We  do  not  know  the  accuracy  of  this  data,  which  was  taken 
using  radial  case  pin  holes  as  angle  reference  locations.  Clearly,  the 
effects  of  angular  errors  will  depend  on  the  actual  shape  of  the 
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measured  case  features.  A perfectly  circular  case,  for  example,  would 
look  circular  regardless  of  the  angular  locations  of  the  measured  radii. 

We  modelled  a set  of  angle  errors  approximating  the  calibration  data  and 
used  this  computer-generated  error  set  to  corrupt  the  part  measurement 
data  from  MSFC  data  file  07248709.49.  The  angular  error  function  was 
the  second  harmonic  form 


^ = “^MAX  sin(2^  ) , (16) 

where  4>(6)  is  the  angle  error  at  a nominal  angle  6 and 
maximum  error.  At  each  nominal  angle  the  error  <i>  was  added  to  8 to 
yield  the  angle  used  in  the  fitting  algorithm.  The  results  of  this 
procedure  are  as  follows; 


AX  (deg) 

Mean  Diameter  (inches) 

Delta  Diameter  (inches) 

0 

144.5900 

0 

+0.1 

144.5905 

+0.0005 

+0.2 

144.5910 

+0.0010 

+0.3 

144.5916 

+0.0016 

+0.4 

144.5921 

+0.0021 

+0.5 

144.5926 

+0.0026 

The  results  for  negative  values  of  show  diameter  changes  of  equal 

magnitude  and  opposite  sign  to  those  above.  We  see  here  that  resolver 
errors  can  affect  the  measurement  results  at  the  level  of  0.001  inches 
if  the  measured  errors  are  accurate.  This  suggests  that  the  PHD 
resolver  systems  be  more  accurately  calibrated  or  be  replaced  by  more 
accurate  angle  transducers. 

Based  upon  these  studies  and  numerical  experiments,  we  estimate  that  the 
maximum  diameter  error  due  to  the  MSFC  analysis  software  is 
ADsoft  ~ ±1500  microinches.  We  note  that  the  contribution  of  resolver 
error  is  not  really  a software  error  but  we  have  included  it  here  since 
the  effects  of  such  error  are  not  readily  apparent  until  the  PHD  data 
has  been  reduced  and  analyzed. 


7.  ESTIMATED  TOTAL  SYSTEM  ERROR 

The  PHD  measurement  accuracy  can  now  be  estimated  by  combining  the 
separate  diameter  error  estimates  according  to  Equation  (6).  As 
explained  in  Section  5,  the  wide  range  of  thermal  environments 
encountered  during  calibration  and  measurement  precludes  any  unique 
value  for  the  system  accuracy.  Accordingly  we  present  three  estimates; 
a worst  case,  a best  case  (given  the  current  state  of  temperature 
control),  and  a potential  accuracy  achieved  by  better  temperature 
control . 
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A. 


WORST  CASE  ESTIMATE 


PMD  calibrated  at  68±0.5°F,  part  measured  at 
88±0.5°F. 

From  Equation  (6): 


ADj  0 T A L — “ 


35 

(702)2  + (1061)2  + (3188)2  + (1500)2 


= ±3746  microinches 


B.  BEST  CASE  ESTIMATE 


PMD  calibrated  and  part  measured  at  68±0.5°F. 
From  Equation  (6): 


^^TOTAL  “ - I ( 


(702)2  + (1061)2  + (1461)2  + (1500)' 


= ±2450  microinches 


C.  POTENTIAL  ACCURACY 

PMD  calibrated  and  part  measured  at  68±0.2°F. 
From  Equation  (6): 


ADj  0 T A L 


= + 


(635)2  + (1061)2  ^ (693)2  + (1500)2 


^5 


= ±2064  raicroinches 


8 . DISCUSSION 


The  error  budget  formalism  used  in  this  analysis  can  serve  as  a valuable 
tool  for  potential  PMD  accuracy  enhancement.  Many  of  the  individual 
error  components  could  be  measured  and  the  error  estimates  re-calculated 
based  on  the  measurement  results.  One  clear  example  of  this  procedure 
is  the  angle  measuring  resolver  system.  This  system  could  be  accurately 
calibrated  and  an  error  map  created.  This  map  would  then  provide  a 
look-up  table  for  data  correction.  Alternatively,  the  resolver  could  be 
replaced  by  a high-accuracy  absolute  optical  encoder  so  that  angular 
error  would  be  negligible.  The  important  point  is  that  a means  exists 
for  a quantitative  analysis  of  PMD  error  reduction  as  more  information 
becomes  available. 
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APPENDIX  A 


ANSI  Standard  B89.6.2  - 1973 


Temperature  and  Humidity  Environment  for  Dimensional  Measurement 
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FOREWORD 


American  National  Standards  Committee  B89  on  Dimensional  Metrology,  organized  under  the 
procedures  of  the  American  National  Standards  Institute,  was  formed  to  develop  certain  minimum  stand- 
ards for  the  various  parameters  in  metrology  and  represents  the  consensus  of  United  States  industry.  The 
various  subcommittees  of  Committee  B89  deal  with  the  different  parameters,  i.e.,  environment,  angle, 
length,  geometry,  etc.  Subcommittee  B89.6  is  assigned  the  task  of  developing  standards  in  physical  environ- 
ment and  the  effects  of  this  environment  and  other  extraneous  influences  on  accuracy  and  precision  of 
dimensional  measurements.  This  standard  for  temperature  and  humidity  is  the  work  of  the  ANSI  B89.6.2 
Working  Group.  The  results  of  its  cooperative  efforts  are  expressed  in  this  document. 

The  effect  of  heat  flow  and  resulting  temperature  gradients,  differences  and  variation  from  measure- 
ment to  measurement  can  result  in  errors  of  dimensional  measurement  because  of  the  thermal  expansion 
properties  of  materials.  By  international  agreement  the  true  size  and  shape  of  an  object  is  that  which 
exists  at  a uniform  temperature  of  68°  F (20°  C).  The  purpose  of  this  standard  is  to  provide  American  industry 
with  practical  requirements,  procedures,  and  methods  by  which  the  intent  of  the  international  agreement 
can  be  satisfied  without  compromise  to  economical  operation. 

In  discharging  its  responsibilities,  the  Working  Group  has  recognized  two  basic  needs  of  industry. 
First,  it  recognizes  the  need  for  standard  approaches  to  the  buying  and  selling  of  artificially  controUed  en- 
vironments. Second,  it  recogruzes  the  need  for  the  qualification  of  individual  measurements  regarding  errors 
induced  by  non-ideal  temjjerature  conditions. 

Standard  specifications  for  artificially  controlled  environments,  in  terms  of  the  quality  of  temperature 
control,  are  especially  necessary  as  a means  of  communicating  metrological  requirements  to  construction 
agencies  such  as  heating  and  air-conditioning  contractors.  In  specific  instances,  sufficient  experience  has 
been  obtained  such  that  required  dimensional  accuracies  can  be  translated  directly  into  temperature  control 
specifications.  However,  the  Working  Group  has  concluded  that  no  general  set  of  temperature  control 
specifications  can  be  stated  that  will  simultaneously  assure  levels  of  measurement  accuracy  and  avoid  the 
risk  of  overdesign  or  underdesign.  Indeed,  no  recommendation  can  be  made  on  which  type  of  artificial  en- 
vironment, or  even  whether  one  is  necessary  or  not,  that  would  represent  the  most  satisfactory  engineering 
for  every  application.  Consequently,  the  Working  Group  has  chosen  to  list  those  properties  of  an  artificially 
controlled  environment  that  must  be  specified  for  an  adequate  description,  to  specify  standard  procedures 
for  the  administration  of  the  required  specifications,  and  to  provide  advisory  information  in  the  form  of 
guidelines  that  the  users  of  this  standard  may  find  helpful  in  the  development  of  specifications  adapted  to 
individual  needs. 

The  metrologist,  his  management,  or  a potential  customer  of  a metrological  service  has,  each  for  his 
own  purpose,  a need  and  a right  to  know  the  magnitude  of  measurement  errors  induced  by  the  thermal  en- 
vironment. Therefore,  this  standard  includes  a description  of  procedures  for  the  estimation  of  the  error  con- 
tributions caused  by  various  defects  of  the  thermal  environment.  Further,  there  is  a need  for  a convenient 
means  of  communication  between  these  parties.  For  this  purpose,  the  Working  Group  has  provided  a stand- 
ard figure  of  merit,  the  Thermal  Error  Index.  Because  this  document,  for  the  first  time,  presents  the  Thermal 
Error  Index  for  use  by  industry  at  large,  the  methods  for  its  determination  and  use  are  carefully  developed 
in  an  appiendix. 

Recommendations  for  the  control  of  humidity  in  metrological  environments  are  included  in  this 
document,  because  it  is  often  directly  affected  by  and  related  to  the  control  of  temp>erature,  espiecially  in 
the  design  of  room  enclosures. 

After  approval  by  the  B89  National  Standards  Committee  and  submittal  to  public  review  the  Stand- 
ard was  approved  by  ANSI  as  a National  Standard  on  October  30,  1973. 
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AMERICAN  NATIONAL  STANDARD 

TEMPERATURE  AND  HUMIDITY  ENVIRONMENT 
FOR  DIMENSIONAL  MEASUREMENT 


1.  SCOPE  AND  INTENT 

This  standard  is  intended  to  fill  industry’s  need  for 
standardized  methods  of: 

a.  Describing  and  testing  temperature-controlled 
environments  for  dimensional  measurements,  and 

b. *  Assuring  itself  that  temperature  control  is 
adequate  for  the  calibration  of  measuring  equipment, 
as  well  as  the  manufacture  and  acceptance  of  work- 
pieces. 

2.  REFERENCED  DOCUMENTS 

2.1  Standards  and  Specifications 

This  standard  has  been  coordinated  insofar  as  pos- 
sible with  the  following  standards  and  specifications. 
Unless  stated  otherwise,  the  latest  issue  is  implied. 

2.1.1  Governmental 


tion,  and  Air-Conditioning  Engineers,  345  East  47th 
Street,  New  York,  New  York  10017 


3.  DEFINITIONS 

3.1  Average  Coefficient  of  Expansion 

The  average  coefficient  of  expansion  of  a body 
over  the  range  of  temperature  from  68°  F (20°  C)  to  r 
is  defined  as  the  ratio  of  the  fractional  change  of 
length  of  the  body  to  the  change  in  temperature. 

Fractional  change  of  length  is  based  on  the  length 
of  the  body  at  68°  F (20°  C). 


a (68,  r)  = 


~ -^68 

■^68  U ~ 68) 


(1) 


Hereinafter  the  term  “coefficient  of  expansion” 
shall  refer  only  to  the  average  value  over  a range  from 
68  F (20  C)  to  another  temperature,  t. 


a.  Ml L-C-45662A— Calibration  System  Require- 
ments 

b.  MIL-HDBK-52— Evaluation  of  Contractor’s  Cali- 
bration System 

c.  MlL-0-9858A-Quality  Program  Requirements 

d.  Fed.  Std.  #209— Clean  Room  and  Work  Station 
Requirements,  Controlled  Environment. 

2.1.2  Non-governmental 

a.  Standards  of  the  American  National  Standards 
Institute  (ANSI),  formerly  United  States  of  America 
Standards  Institute  (USASI), 

b.  Standards  of  the  American  Society  for  Testing 
and  Materials  (ASTM), 

c.  Standards  of  the  Society  of  Automotive  Engi- 
neers, Inc.  (SAE), 

d.  Recommendation  R1  -Standard  Reference  Tem- 
perature for  Industnal  Length  Measurements,  Inter- 
national Organization  for  Standardization  (ISO). 

2.2  Other  Publications 

a.  ASHRAE-Handbook  of  Fundamentals  pub- 
lished by  the  Amencan  Society  of  Heatmg,  Refngera- 


3.2  Coefficient  of  Expansion 

The  true  coefficient  of  expansion,  a,  at  a tem- 
perature, /,  of  a body  is  the  rate  of  change  of  length 
of  the  body  with  respect  to  temperature  at  the  given 
temperature  divided  by  the  length  at  the  given  tem- 
perature. 


3.3  Comparator 

Any  device  used  to  perform  the  comparison  of  the 
part  and  the  master  is  called  a comparator. 

3.4  Differential  Expansion 

Differential  expansion  is  defined  as  the  difference 
between  the  expansion  of  the  part  and  the  expansion 
of  the  master  from  68°  F (20°  C)  to  their  time-mean 
temperatures  at  the  time  of  the  measurement. 

3.5  Differential  Response 

Differentia]  response  is  defined  as  the  relative 
length  vanation  between  any  two  objects  per  unit 
smusoidal  environment  temperature  oscillation  as  a 
function  of  frequency  of  temperature  oscillation 
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3.6  Full-Scale  Dilatofnetry 

Full-scale  dilatomctry  is  a priKcdurc  for  deter- 
mining the  average  true  coefficient  of  expansion  of  a 
workpiece. 

3.7  Dimensional  Response 

Dimensional  response  is  defmed  as  the  amplitude 
of  absolute  length  variation  of  cn  object  per  unit  of 
sinusoidal  environment  teruperature  oscillation  as  a 
function  of  the  frequency  of  temperature  oscillation. 

3.8  Drift  Test 

An  experiment  conducted  to  determine  the  actual 
drift  inherent  in  a measurement  system  under  normal 
operating  conditions  is  called  a drift  test.  Since  the 
usual  method  of  monitoring  the  environment  (see 
Definition  3.13)  involves  the  correlation  of  one  or 
more  temperature  recordings  with  drift,  the  test  wiU 
usually  consist  of  simultaneous  recordings  of  drift 
and  environmental  temperatures.  The  recommended 
procedure  for  the  conduct  of  a drift  test  is  given  in 
20.3.1. 

3.9  Master 

The  standard  against  which  the  desired  dimension 
of  the  part  is  compared  is  called  the  master.  The 
standard  may  be  in  the  form  of  the  wavelength  of 
light,  the  length  of  a gage  block,  line  standard,  lead 
screw,  etc. 

3.10  Mastering 

The  action  of  nulling  or  setting  a comparator  with 
a master  is  called  mastering. 

3.11  Mastering  Cycle  Time 

The  time  between  successive  mastenngs  of  the 
process  is  called  the  mastering  cycle  time  of  the 
process. 

3.12  Measurement  Cycle  Time 

The  time  between  measuring  and  the  previous 
mastering  is  called  measurement  cycle  time. 

3.13  Monitoring 

To  ensure  the  constancy  of  the  Thermal  Error 
Index  (see  3.22),  it  will  be  necessary  to  monitor  the 
process  in  such  a way  that  significant  changes  in 
operating  conditions  are  recognizable. 

The  recommended  procedure  is  to  establish  a 
particular  temperature  recording  station  or  stations 
which  have  a demonstrable  correlation  with  the  mag- 
mtude  of  the  drift. 

The  temperature  of  the  selected  station  should  be 
recorded  contmuously  dunng  any  measurement 
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process  lo  which  Ihc  iiulex  is  lo  he  applied  II  ihe 
recording  shows  a sigiiilicaiil  change  of  comlilums,  Ihe 
index  is  null  and  void  lor  that  process,  and  a re- 
evaluation  of  the  index  should  be  conducted,  or  the 
conditions  corrected  to  those  for  which  the  index 
applies. 

In  addition  to  continuous  monitoring  of  environ- 
mental conditions,  it  is  recommended  that  efforts  be 
made  to  establish  that  the  process  is  properly  soaked 
out.  This  may  be  done  by  checking  the  temperature 
of  all  elements  before  and  after  the  execution  of  the 
measurements. 

3.14  Nominal  Coefficient  of  Expansion 

The  estimate  of  the  coefficient  of  expansion  of  a 
body  shall  be  called  the  nominal  coefficient  of  expan- 
sion. To  distinguish  this  value  from  the  average  co- 
efficient of  expansion  a (68,  r)  it  shall  be  denoted  by 
the  symbol  x . 

3.15  Nominal  Differential  Expansion* 

The  difference  between  the  Nominal  Expansion  of 
the  part  and  of  the  master  is  called  the  Nommal  Dif- 
ferential Expansion; 

NDE  = (NE)p3„  -(NE) 

master  ■ (3) 

3.16  Nominal  Expansion* 

TTie  estimate  of  the  expansion  of  an  object  from 
68°  F to  its  time-mean  temperature  shall  be  called  the 
Nominal  Expansion,  and  it  shall  be  determined  from 
the  following  relationship: 

NE  = x (Z.)(r  - 68)  . (4) 

3.17  Part  Of  Workpiece 

In  every  dimensional  or  geometric  measurement 
process,  there  is  usually  some  physical  object  for 
which  a dimension  is  to  be  determined.  This  object  is 
called  the  part  or  workpiece. 

3.18  Soak  Out 

One  of  the  characteristics  of  an  object  is  that  it  has 
a thermal  “memory”.  When  a change  in  environment 
IS  expenenced,  such  as  occurs  when  an  object  is 
transported  from  one  room  to  another,  there  will  be 
some  period  of  time  before  the  object  completely 
“forgets”  about  its  previous  environment  and  ex- 
hibits a response  dependent  only  on  its  current  en- 
vironment. The  time  elapsed  following  a change  in  en- 
vironment until  the  object  is  influenced  only  by  the 
new  environment  is  called  soak  out  time.  After  soak 


•These  concepts  are  used  in  determining  the  Thermal  trror 
Index  in  Section  b. 
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out,  the  object  is  said  to  be  in  equilibrium  with  the 
new  environment.  In  cases  where  an  environment  is 
time  variant,  the  response  of  the  object  is  also  a 
variable  in  time. 

3.19  Temperature  of  a Body 

3.19.1  Temperature  at  a Point.  When  discussing  a 
body  which  does  not  have  a single  uniform  tempera- 
ture, it  is  necessary  to  refer  in  some  manner  to  the  dis- 
tribution of  temperature  throughout  the  body.  Tem- 
perature at  a pomt  in  a body  is  assumed  to  be  the  tem- 
perature of  a very  small  volume  of  the  body 
centered  at  that  point.  The  material  of  which  the 
body  IS  composed  is  assumed  to  form  a continuum. 

3.19.2  The  Temperature  of  a Body.  When  the  dif- 
ferences between  the  temperatures  at  all  points  in  a 
body  are  negligible,  the  body  is  said  to  be  at  a uniform 
temperature.  This  temperature  is  then  the  tempera- 
ture of  the  body. 

3.19.3  Instantaneous  Average  Temperature  of  a 
Body.  Whan  the  body  is  not  at  a uniform  temperature 
at  all  points,  but  it  is  desirable  to  identify  the  thermal 
state  of  the  body  by  a single  temperature,  the  tem- 
perature which  represents  the  total  heat  stored  in  the 
body  may  be  used.  When  the  body  is  homogeneous, 
this  is  called  the  average  temperature  of  the  body 
(This  temperature  is  the  average,  over  the  volume  of 
the  body,  of  all  point  temperatures.). 

3.19.4  Time-Mean  Temperature  of  a Body.  The 
average  of  the  average  temperature  of  a body,  over  a 
fixed  period  of  time,  is  called  the  time-mean  tempera- 
ture of  the  body.  The  fixed  period  is  selected  as  ap- 
propriate to  the  measurement  problem. 

3.20  Temperature  Variation  Error,  TVE 

An  estimate  of  the  maximum  possible  measure- 
ment error  induced  solely  by  deviation  of  the  environ- 
ment from  average  conditions  is  called  the  Tempera- 
ture Variation  Error.  TVE  is  determmed  from  the 
results  of  two  drift  tests,  one  of  the  master  and  com- 
parator and  the  other  of  the  part  and  the  comparator. 

3.21  Thermal  Conductivity 

Thermal  conductivity  is  normally  defined  as  the 
time  rate  of  heat  flow  through  unit  area  and  unit 
thickness  of  a homogeneous  material  under  steady 
conditions  when  a umt  temperature  gradient  is  main- 
tained in  the  direction  perpendicular  to  area.  In  this 
standard  it  is  designated  by  K and  has  the  units  of 
BTU/hr  fi^  °F. 
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3.22  Thermal  Error  Index 

The  summation,  without  regard  to  sign,  of  the  es- 
timates of  aU  thermally  induced  measurement  errors, 
expressed  as  a percentage  of  the  working  tolerance 
(or  total  permissible  error). 

3.23  Thermal  Expansion 

The  difference  between  the  length  (or  volume)  of  a 
body  at  one  temperature  and  its  length  (or  volume)  at 
another  temperature  is  called  the  linear  (or  volumetnc) 
thermal  expansion  of  the  body. 

3.24  Thermally  Induced  Drift 

Drift  is  defined  as  the  differential  movement  of 
the  part  or  the  master  and  the  comparator  caused  by 
the  time  variations  in  the  thermal  environment. 

3.25  Time  Constant  of  a Body 

The  time  required  for  a physical  quantity  to  change 
its  initial  (zero-time)  magnitude  by  the  factor  (1  - l/e) 
when  the  physical  quantity  is  varying  as  a function  of 
time,  / (0  according  to  either  the  decreasmg  ex- 
ponential function, 

/(;)  = e-*^ 

or  the  increasing  exponential  function, 
f{t)  = 1 

when  k=  1 /r,  it  is  called  the  time  constant  of  the  phy- 
sical quantity.  In  this  standard  it  is  designated  by  t. 

Since  e has  the  numeric  value  2.7 1 828—,  the  change 
in  magnitude  (1  - 1/e)  has  the  fractional  value 
0.63212—.  Thus,  after  a time  lapse  of  one  time  con- 
stant, starting  at  zero-time,  the  magnitude  of  the  phy- 
sical quantity  will  have  changed  approximately  63.2 
percent. 

The  time  constant  of  a body  can  be  used  as  a 
measure  of  the  response  of  the  body  to  environ- 
mental temperature  changes.  It  is  the  time  required 
for  a body  to  achieve  approximately  63.2  percent  of 
its  total  change  after  a sudden  change  to  a new  level 
in  its  environment. 

3.26  Transducer  Drift  Check 

An  experunent  conducted  to  determine  the  drift  in 
a displacement  transducer  and  its  associated  amplifiers 
and  recorders  when  it  is  subjected  to  a thermal  en- 
vironment similar  to  that  bemg  evaluated  by  the  drift 
test  itself.  The  transducer  drift  is  the  sum  of  the 
“pure”  amplifier  drift  and  the  effect  of  the  environ- 
ment on  the  transducer,  amplifier,  and  so  on.  The 
transducer  drift  check  is  performed  by  blocking  the 
transducer  and  observing  the  output  over  a period  of 
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lime  .ii  Icust  j.s  i(>ii|i(  js  llic  duration  ol  llie  drill  test  to 
be  performed.  Blocking  a transducer  involves  making  a 
transducer  effectively  indicate  on  its  own  frame,  base, 
or  cartridge.  In  the  case  of  a cartridge-type  gage  head, 
this  is  accomplished  by  mounting  a small  cap  over  the 
end  of  the  cartridge  so  the  plunger  registers  against  the 
inside  of  the  cap.  Finger-type  gage  heads  can  be 
blocked  with  similar  devices.  Care  must  be  exercised 
to  see  that  the  blocking  is  done  in  such  a manner  that 
the  influence  of  temperature  on  the  blocking  device  is 
negligible. 

3.27  Uncertainty  of  Nominal  Coefficient 
of  Expansion 

The  maximum  possible  percentage  difference  be- 
tween the  true  coefficient  of  expansion,  a,  and  the 
nommal  coefficient  of  expansion  shall  be  denoted  by 
the  symbol  5 . 

5 = 100^^  % (5) 

a 

This  value,  like  that  of  k itself,  must  be  an  esti- 
mate. Various  methods  can  be  used  to  make  thrs  esti- 
mate. For  example, 

(a)  The  estimate  may  be  based  on  the  dispersion 
found  among  results  of  actual  expenments  con- 
ducted on  a number  of  like  objects; 

(b)  The  estimate  may  be  based  on  the  dispersion 
found  among  published  data. 

Of  the  two  possibilities  given  above,  (a)  is  the 
recommended  procedure. 

Because  the  effects  of  inaccuracy  of  the  estimate 
of  the  uncertainty  are  of  second  order,  it  is  con- 
sidered sufficient  that  good  judgment  be  used. 

3.28  Uncertainty  of  Nominal  Differential  Expansion 

The  sum  of  Uncertainties  of  Nominal  Expansion 
of  the  part  and  master  is  called  the  Uncertainty  of 
Nominal  Differential  Expansion. 

UNDE  = (UNE)p3rt  + (UNEj^.er  (6) 

3.29  Uncertainty  of  Nominal  Expansion 

The  maximum  difference  between  the  true  thermal 
expansion  and  the  nommal  expansion  is  called  the  Un- 
certainty of  Nominal  Expansion.  It  is  determmed 
from 

UNE  = »cI(r-68) 


•See  Equation  23.  Paragraph  20.2  for  possible  revision. 
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4.  GENERAL  REQUIREMENTS 

0 

4.1  The  methods  of  describing  and  testing  tempera- 
ture-controlled environments  shall  be  in  accordance 
with  Section  5. 

4.2  A calibration,  part  manufacture,  or  part  ac- 
ceptance procedure  compUes  with  this  standard  if  it 
is  carried  out  with  all  pertinent  components  of  the 
measurement  system  at  68°  F;  or  if  it  can  be  shown 
that  the  Thermal  Error  Index  (as  defined  in  Section 
6)  is  a reasonable  and  acceptable  percentage  of  the 
working  tolerance. 

5.  DESCRIPTION  AND  TESTING  OF 

ENVIRONMENT 

In  this  section  an  environment  is  to  be  understood 
as  a room,  box  or  other  enclosure  through  which  a 
temperature-controlled  fluid  (liquid  or  gaseous)  is 
circulated  and  which  is  intended  to  contain  dimen- 
sional measurement  apparatus. 

5.1  Description  of  Environment 

In  the  followmg  paragraphs  the  essential  properties 
of  an  environment  are  listed.  These  characteristics 
must  be  unequivocally  specified. 

5.1.1  Thermal  Specifications.  The  following  prop- 
erties of  a controlled  environment  must  be  specified. 

5. 1. 1. 1 Cooling  Medium.  The  type  of  cooling 
medium  is  to  be  described  in  terms  of  its  chemical 
composition  and  physical  properties  of  viscosity,  den- 
sity, specific  heat  and  thermal  conductivity.  When 
common  substances  such  as  ambient  air  or  water  are 
to  be  used,  unless  otherwise  specified,  their  properties 
are  to  be  assumed  those  given  in  standard  tables. 

Commercial  fluids  such  as  oils  may  be  specified  by 
manufacturer  and  type. 

5. 7. 1.2  Flow  Rate  and  Velocity.  The  flow  rate  of 
the  cooling  medium  shall  be  spiecified  in  units  of 
weight  per  unit  time,  volume  per  unit  time,  or 
changes  per  unit  time.  Velocity  shall  be  specified  in 
feet  per  umt  time. 

5. 7. 1.3  Ranges  of  Frequencies  of  Temperature 
Variation  and  Limit  from  Mean  Temperature.  These 
two  properties  are  interrelated  and  cannot  be  specified 
separately.  For  example,  in  general,  the  higher  the 
frequency  the  wider  the  permissible  tempierature  ex- 
cursions from  the  mean  temp>erature  in  the  cooling 
medium  (see  Section  10).  Frequencies  are  to  be 
specified  in  cycles  per  unit  time,  and  limits  from  mean 
temperature  in  plus  or  minus  (±)  units  Fahrenheit 
(units  Celsius).  Separate  limit  specifications  may  be 
applied  to  a number  of  frequency  ranges. 
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5. 1. 1.4  Mean  Temperature.  The  mean  temperature 
shaJI  be  the  time  average  temperature  at  a specified 
point  (or  time  average  of  the  average  of  temperatures 
at  more  than  one  specified  point)  within  the  bounda- 
ries of  the  environment.  A period  of  time  over  which 
the  time  average  is  to  be  computed  shall  be  specified. 

5. 1. 1.5  Gradients.  Within  the  working  volume  of 
the  environment,  maximum  steady-state  temperature 
differences  are  to  be  specified.  The  specification  can 
take  one  or  both  of  two  forms: 

(a)  “Worst  case”  maximum  temperature  difference 
in  the  cooling  medium  between  any  two  points  within 
the  specified  boundaries  of  the  environment; 

(b)  Maximum  rate  of  change  of  temperature  along 
one  or  more  specified  directions  within  the  specified 
boundaries. 

S^cifications  can  be  applied  to  sub-boundanes,  or 
volumes  within  volumes. 

Each  such  specification  should  be  qualified  as  to 
the  conditions  of  acceptance  testing,  e.g.,  whether  or 
not  equipment  and/or  personnel  are  to  be  within  the 
boundaries  during  the  testing. 

5.1.2  Humidity.  Requirements  for  humidity  con- 
trol arise  from  desires  to  provide  human  comfort,  to 
prevent  deleterious  effects  of  moisture  such  as  corro- 
sion of  workpieces  and  measurement  apparatus,  and  to 
maintain  measurement  accuracy  of  workpieces  that 
are  dimensionally  sensitive  to  moisture  (for  example, 
certain  hygroscopic  materials).  Specifications  for 
humidify  control  shall  be  consistent  with  the  practices 
established  by  the  American  Society  of  Heating, 
Refrigeration  and  Air-Conditioning  Engineers 
(ASHRAE). 

5.1.3  Maintainability.  Requirements  shall  be  speci- 
fied governing  the  maintenance  of  performance  in  ac- 
cordance with  the  above  requirements  in  order  that 
deterioration  of  the  environment  with  time,  due  to 
the  reduction  of  control  efficiency,  can  be  held  within 
acceptable  limits  by  implementation  of  established 
operating  and  maintenance  procedures. 

5.2  Testing  of  Environments 

5.2.1  Thermal  Specifications 

5.2. 1. 1 Cooling  Medium.  When  a cooling  medium 
other  than  air  or  water  is  to  be  supplied  as  a- part  of 
the  environment,  its  thermal  properties  must  be 
qualified.  The  standard  test  methods  listed  here  may 
be  used  to  determine  the  required  properties.  The  bst 
is  not  intended  to  be  exhaustive,  but  is  only 
representative  of  the  many  standard  procedures 
available. 
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5. 2. 1.1.1  Viscosity 

ASTM  D445-65  - Viscosity  of  Transparent  and 
Opaque  Liquids 

ASTM  DI 545-63  - Viscosity  of  Transparent  Liq- 
uids by  Bubble  Time  Method 

5.2.1. 1.2  Density  (Specific  Gravity) 

ASTM  D941-55  (Reapproved  1968)-Density  and 
Specific  Gravity  of  Liquids  by 
Lipkin  Bicapillary  Pycnometer 

ASTM  Dl  298-67  - Density,  Specific  Gravity  or 
API  Gravity  of  Crude  Petro- 
leum and  Liquid  Petroleum 
Products  by  Hydrometer  Meth- 
od 

5.2. 1.1.3  Thermal  Conductivity 

ASTM  D2717-68T— Thermal  Conductivity  of  Liq- 
uids 

5.2. 1.2  Flow  Rate  and  Velocity 

5. 2. 1.2.1  Flow  Rate 

ASTM  D2458-69  - Flow  Measurement  of  Water 
by  the  Venturi  Meter  Tube 

ISOR541-I967  — Measurement  of  Fluid  Flow  by 
Means  of  Orifice  Plates  and 
Nozzles 

5.2. 1. 2.2  Velocity 

ASHRAE  Handbook  lists  several  accepted  test 
methods. 

5.2. 1.3  Ranges  of  Frequencies  of  Temperature 
Variation  and  Limits  from  Mean  Temperature.  Limits 
of  variation  from  mean  temf>erature  in  the  cooling 
medium  at  any  specified  point  or  points  within  the 
specified  boundaries  is  to  be  determined  by  use  of  a 
sensitive  recording  thermometer.  The  time  constant 
of  this  mstrument  is  to  be  no  more  than  one-fifth 
( 1 /5)  of  the  period  of  the  shortest  cycle  period  (highiest 
frequency)  of  interest;  and  its  resolution  is  to  be  at 
least  one-tenth  (1/10)  of  the  smallest  amplitude  of 
specified  temperature  variation. 

The  temperature  recording  duration  shall  be  a mini- 
mum of  24  hours  and  should  be  as  long  as  the 
representative  work  cycle  (e.g.,  a week).  The  test 
should  be  performed  under  worst-case  conditions  (i.e.. 
hottest  day  of  year  and  coldest  day  of  year). 

The  maximum  peak-to-vaUey  temperature  varia- 
tion is  to  be  determined  from  the  recorded  data  for 
every  discernible  frequency  component.  Isolated  dis- 
turbances, i.e.,  single  “spikes”,  are  to  be  regarded  as  a 
component  of  the  appropriate  frequency. 
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Limits  from  mean  for  each  frequency  componenl 
arc  to  be  calculated  as  one-half  (Vi)  of  tJic  observed 
pcak-to-valley  excursion. 

5.2.1. 4 Mean  Temperatures.  A thermometer  that 
has  been  calibrated  by  comparison  with  a standard 
platinum-resistance  thermometer  in  the  specified  cool- 
ing medium  is  to  be  used  to  determine  mean  tempera- 
ture. A recording  thermometer  whose  output  is 
averaged  over  the  test  period  is  preferred.  However,  a 
thermometer  with  a large  time  constant  can  be  used  if 
it  is  read  at  a frequency  corresponding  to  one-half 
(Vi)  of  its  time  constant  over  the  test  period  and  all 
such  readings  averaged. 

The  resolution  of  the  test  thermometer  shall  be 
one-tenth  (1/10)  of  the  specified  tolerance  for  the 
mean  temperature.  Also,  the  test  thermometer  should 
be  standardized  or  calibrated  so  that  in  use  it  would 
indicate  temperatures  with  an  inaccuracy  no  worse 
than  one-fourth  (Vi)  of  the  specified  tolerance  for  the 
mean  temperature. 

5.2. 1.5  Gradients.  If  a “worst  case”  specification 
is  to  be  administered,  the  locations  of  the  temperature 
sensors  are  to  be  clearly  specified. 

If  a maximum  rate  of  change  of  temperature  per 
unit  length  in  a given  direction  or  directions  is  to  be 
administered,  a grid  pattern  shall  be  established  in 
define  the  locations  of  temperature  sensors.  In  the 
case  of  room,  box,  and  tank  enclosures,  that  fraction 
of  the  total  volume  immediately  adjacent  to  the  en- 
closure walls  is  to  be  excluded  from  the  gnd  pattern. 
Unless  otherwise  specified,  for  an  enclosure  that  is 
empty,  does  not  contain  furruture,  personnel,  and 
equipment  other  than  that  used  in  the  performance  of 
the  test,  the  excepted  volumes  shall  be  those  obtained 
by  reducing  each  dimension  by  10  percent.  For 
example,  a 10'  x 10'  x 10'  room  shall  be  reduced  to 
9'  X 9'  X 9',  the  excluded  volume  being  that  contained 
within  6"  from  the  walls,  ceiling,  and  floor. 

If  the  specification  calls  for  testing  with  equipment 
or  {jersonnel  in  the  enclosure,  the  specification  shall 
include  a description  of  excluded  areas  or  volumes  ad- 
jacent to  such  personnel  or  objects. 

Testing  shall  be  performed  over  a representative 
work  period. 

5.2.2  Humidity.  Humidity  in  the  controlled  en- 
vironment is  to  be  measured  by  any  means  having  suf- 
ficient accuracy  to  satisfy  the  design  specifications. 

A sling  psychrerneter  provides  an  economical  and 
convemeni  way  to  monitor  humidity  on  a periodic 
basis. 
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6.  ASSURANCE  OF  ADEQUACY  OF  ENVIRON 

MENTAL  CONTROL-THERMAL  ERROR 

INDEX 

III  the  buying  and  .selling  ol  giHid.s  and  services.  ii 
is  common  practice  that  the  buyer  requests  the  seller 
lo  produce  evidence  of  his  ability  to  satisfy  specifica- 
tions. Most  questions  of  metrological  capability  can  be 
satisfied  by  means  of  available  certification  services, 
e.g.,  gage  block  calibration  by  a competent  agency. 
In  the  special  case  of  thermal  effects  errors,  it  is  some 
times  possible  for  the  seller  to  meet  the  buyer’s  re- 
quirements by  showing  that  work  is  to  be  done  in  an 
environment  of  a description  acceptable  to  the  buyer. 
In  general,  however,  the  variety  of  gages,  workpieces, 
and  measurement  procedures  that  is  found  in  practice 
precludes  having  all  requirements  met  by  even  a small 
choice  of  standard  environment  descriptions. 

The  purpose  of  this  section  of  the  standard  is  to  set 
forth  a procedure  for  the  assessment  of  the  maximum 
possible  measurement  error  due  to  all  ther’-.ai  effects 
Basically,  this  procedure  consists  of  computing  esti- 
mates of  possible  error,  taking  into  account  un- 
certainties involved  in  the  computations,  and  experi- 
mentally determining  other  error  components.  Sum- 
ming all  component  error  estimations  gives  an  esti- 
mate of  the  over-all  maximum  pos.sible  error.  Dividing 
this  number  by  the  total  [KTinissible  error  from  all 
sources  (working  tolerance)  gives  an  index  of  merit 
(Thermal  Error  Index)  that  can  be  u.sed  for  the  ad- 
ministration of  environment  quality  control  require- 
ments. 

In  the  following  paragraphs,  the  standard  proce- 
dure for  computing  the  Thermal  Error  Index  is  de- 
scribed. Only  the  most  significant  components  of  error 
are  considered.  Approximate  methods  of  error  esti- 
mation are  used.  Section  20  of  the  Appendix  includes 
a more  thorough  discussion  of  the  methods  of  error 
estimation  and  possible  means  of  improving  the  ac- 
curacy of  the  estimates.  However,  the  following  are 
the  standard  procedures. 

6.1  Consequences  of  Environment  Mean  Temperature 
Other  than  68°  F (20°  C) 

6.1.1  Length  Measurements 

6. 1. 1. 1 Nominal  Expansion,  NE.  Assuming  that  an 
object  in  a convective  environment  has  a uniform 
temperature  equal  to  the  environment  mean  tempera- 
ture in  its  immediate  vicinity,  its  Nominal  Expansion 
IS  estimated  by 

NE  = k (Z.)(/ - 68).  (8) 

6. 1 . 1.2  Nominal  Differential  Expansion , NDE.  The 
difference  between  the  Nominal  Expansion  of  die  part 
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atul  llu'  Diastci  is  called  (lie  Noniiiial  Diilerenlial  I x- 

p.'UISliMI 

Ni)i;  = (Ni:)p„rt  (•>) 

6.1.2  Measurements  Other  than  Length.  In  cases 
of  measurements  other  than  length,  where  a standard 
computational  method  is  not  given,  the  estimation 
of  the  consequences  of  environment  mean  tempera- 
tures other  than  68°  F (20°  C)  shall  be  made  according 
to  formulae  appropriate  to  the  specific  case,  if  pos- 
sible. An  example  is  given  in  Section  20  of  the 
Appendix. 

Satisfactory  formulae  with  which  to  carry  out  the 
intent  of  this  section  are  not  always  avaiiable  because 
of  insufficient  technical  knowledge  of  each  specific 
case. 

6.2  Consequences  of  Uncertainties  of  Error 
Computations 

6.2.1  Length  Measurement 

6.2. 1. 1 Uncertainty  of  Nominal  Expansion,  UNE. 
The  Uncertainty  of  Nominal  Expansion  is 

UNE  = k (5)(Z.)(/ - 68)/!00%*  (10) 

where  t is  the  worst-case  (greatest  difference  from  68) 
measured  temperature  of  the  object  (part  or  master). 

•Rearrangement  of  E<^uation  7,  Paragraph  3.29. 

The  fact  that  it  is  mandatory  to  make  use  of  direct- 
ly measured  temperatures  in  the  calculation  of  Un- 
certainty of  Nominal  Expansion  means  that  the  intent 
of  Section  6.4  is  automatically  satisfied  for  the  case 
of  length  measurements. 

6.2. 1.2  Uncertainty  of  Nominal  Differential  Ex- 
pansion. UNDE.  The  sum  of  the  Uncertainties  of 
Nominal  Expansion  of  the  part  and  master  is  called 
the  Uncertainty  of  Nomina]  Differential  Expansion. 

6.2.2  Measurements  Other  than  Length.  In  cases 
of  measurements  other  than  length,  where  a standard 
computational  method  is  not  given,  an  estimation  of 
the  possible  consequences  of  the  uncertamties  of  co- 
efficients of  expansion  and  temperature  measure- 
ments shall  be  made  according  to  formulae  appro- 
priate to  tJie  specific  case  if  posable.  An  example  is 
given  in  Section  20  of  the  Appendix. 

Satisfactory  formulae  with  which  to  carry  out  the 
intent  of  this  section  are  not  always  available  because 
of  insufficient  technical  knowledge  of  each  specific 
case. 


6.3  Contequoncos  of  Time  Variation  of  Temperature 
Length  Measurements,  Temperature  Variation 
Error.  TVE 

llic  maximum  observed  or  recorded  iticrnial  drill 
during  cither  part/comparator  or  master/comparator 
drift  test  (see  Appendix),  whichever  gives  the  larger 
value,  during  a period  of  time  corresponding  to  the 
measurement  cycle  is  called  the  Temperature  Variation 
Error. 


6.4  Consequences  of  Gradients  in  Environment 
Temperature 

In  some  measurements,  gradients  in  environment 
temperature  have  a resultant  error  effect  that  is 
distinct  from  those  described  in  the  preceding  para- 
graphs and  which  is  significant  enough  to  be  given 
special  consideration.  For  example,  in  the  use  of  sur- 
face plates  the  consequences  of  an  environment  mean 
temperature  other  than  68°  F (20°  C)  are  insignificant 
provided  the  material  of  the  surface  plate  is  sufficient- 
ly homogeneous  with  respect  to  thermal  expansion 
properties.  However,  the  control  of  temperature  dif- 
ferences between  the  top  and  bottom  of  the  surface 
plate  IS  of  prime  importance. 

No  general  formulae  can  be  given  for  the  estunation 
of  gradient  temperature  effects. 


6.5  Thermal  Error  Index,  TEI 

The  sum  of  all  the  approximate  thermal  effects 
error  components  from  Paragraphs  6.1,  6.2,  6.3,  and 
6.4,  where  such  paragraphs  apply,  expressed  as  a 
percentage  of  the  total  permissible  error  from  all 
sources  is  called  the  Thermal  Error  Index. 

For  length  measurements. 


TEI  = 


NDE  -t-  UNDE  + TVE 
Total  piermissible  error 


X 100% 


1) 


if  no  correction  for  differential  expansion  is  attempted, 
and 


TEI  = 


UNDE  + TVE 
Total  permissible  error 


X 1 00%  (12) 


if  a correction  for  differential  expansion  is  computed 
and  applied  in  the  measurement  procedure. 
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APPENDIX 


Historical  Background  of  Standard  Temperatures  for  Dimensional  Standards' 


The  presently  recognized  standard  temperature  of 
20°  Celsius  (68°  Fahrenheit)  was  preceded  by  at  least 
two  others;  namely,  0°  Celsius  (32°  Fahrenheit),  the 
temperature  of  melting  ice,  and  16-2/3°  Celsius  (62° 
Fahrenheit)  which  historically,  at  least,  appears  to 
have  been  the  earliest. 

Zero  Celsius  was  the  temperature  adopted  by  the 
International  Congress  for  Weights  and  Measures  at 
Paris  in  1889  at  which  the  platinum-indium  bar, 
maintained  at  the  International  Bureau  of  Weights  and 
Measures  at  Sevres,  France,  represented  the  meter 
exactly.  However,  its  length  at  20°  Celsius  had  been 
carefully  determined  and  for  many  years  the  com- 
pansons  of  the  various  national  standard  meter  bars 
with  the  international  standard  bar  were  made  at  20° 
Celsius. 

France,  however,  continued  to  use  0°  Celsius  as  the 
standard  temperature  for  length  standards  and  gages 
until  1931,  when  20°  Celsius  was  adopted  inter- 
nationally. 

Sixteen  two-thirds°  Celsius  (62°  Fahrenheit)  was 
long  recognized  as  the  standard  temperature  for  di- 
mensional standards  in  Great  Britain,  dating  back  to 
at  Icasi  1831.  Like  France,  Great  Britain  switched  to 
20°  Celsius  in  1931. 

As  early  as  1898-99,  C.  E.  Johansson  of  Sweden 
considered  that  the  measurements  given  for  his  meas- 
uring instruments  should  apply  at  19  or  20°  Celsius. 
Since  he  found  the  usual  temperature  was  between  15 
and  25°  Celsius,  he  took  the  mean  value,  20°  Celsius, 
as  the  temperature  easiest  to  maintain  and  generally 
prevailing  in  daily  workshop  practice. 

About  1903,  Johansson  had  a nominally  100- 
millimeter  rod  measured  by  the  International  Bureau, 
which  stated  that  the  rod  was  100  millimeters  at 
20.63°  Celsius.  With  this  information,  Johansson  made 


' This  informalion  was  taken,  in  part,  from  unpublished  notes 
of  Irvin  H.  Fullmer,  former  Chief  of  the  Engineering 
Metrology  Section,  The  National  Bureau  of  Standards. 

’"The  Calibration  and  Dimensional  Changes  of  Precision 
Gage  Blocks,"  C C.  Peters  and  H S.  Boyd,  American 
Machinisi,  September  30  and  October  7,  1920 


a new  rod  0.0007  miUimeters  longer  than  the  first  so 
that  it  would  be  of  correct  length  at  20°  Celsius.  This 
rod  was  then  used  in  subdividing  lengths  to  produce  a 
set  of  gage  blocks  in  various  series. 

From  this  beginning,  the  use  of  20°  Celsius  as  a 
standard  temperature  grew  until  in  April  1931  the 
Internationa!  Committee  of  Weights  and  Measures 
adopted  a resolution  that,  in  the  future,  the  tempera- 
ture of  20°  Celsius  (68°  Fahrenheit)  should  be  univer- 
sally adopted  as  the  normal  temperature  of  adjustment 
for  all  industrial  standards  of  length.  Consequently, 
most  of  the  nations  of  the  world  adopted  this  tem- 
f>erature  as  their  standard  for  length  adjustments. 
Thereafter,  standards  of  length  were  adjusted  to  be 
nominally  correct  at  20°  Celsius  and  manufacturers  of 
gage  blocks,  end  standards,  scales,  tapes,  fixed  dimen- 
sional gages,  lead  screws,  etc.  adjusted  their  manu- 
facturing methods  so  these  devices  would  be  nominal- 
ly correct  at  20°  Celsius. 

In  an  article  by  Peters  and  Boyd  of  the  National 
Bureau  of  Standards  published  in  1920^  we  find  the 
statement,  ‘The  temperature  at  which  the  actual 
length  of  the  gage  equals  the  nominal  length  must, 
therefore,  be  specified  and  is  usually  taken  as  20°C  or 
68°F.” 

The  National  Bureau  of  Standards  installed  its  lirst 
constant-temperature  (20°  Celsius)  room  for  calibrat- 
ing gage  blocks  and  other  dimensional  standards  m 
1924.  Johansson,  himself,  was  responsible  for  the  first 
industrial  room,  at  the  Ford  Motor  Company,  in  1926. 

Twenty  Celsius  thereafter  became  so  generally 
used  that  Recommendation  No.  1 of  the  International 
Organization  for  Standardization,  issued  in  1954 
promulgated  its  use  among  the  40  participating 
countries. 

Therefore,  since  at  least  as  far  back  as  1912  when 
it  was  recorded  that  Johansson  was  makmg  his  gage 
blocks  for  America  on  the  basis  of  1 inch  equals 
25.4  millimeters  and  at  a temperature  of  20°  Celsius, 
millions  of  items  such  as  gage  blocks,  end  standards, 
micrometers,  dimensional  gages  and  products  off  of 
machines  having  lead  screws,  have  been  manufactured 
to  be  nominally  correct  at  20°  Celsius 
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The  argument  frequently  advanced  that  measurc- 
rrrents  can  be  made  at  any  temperature  and  corrected 
to  20°  C (68°  F)by  applying  corrections  based  on  the 
various  coefficients  of  thermal  expansions  is  valid 
only  if  the  coefficients  are  known  with  sufficient  ac- 
curacy. The  importance  of  this  was  known  at  least 
forty  years  ago  when,  in  the  paper  by  Peters  and 
Boyd  of  the  NBS,  referenced  above,  this  statement 
was  made. 

“Another  property  which  must  be  recognized  when 
considering  true  accurate  length  of  gages  is  the 
thermal  expansion  of  the  material.  A 1-inch  steel 
gage  (block)  increases  in  length  about  0.000  013 
inches  for  every  degree  C (Celsius)  rise  in  tempera- 
ture. The  temperature  at  which  the  actual  length  of 
the  gage  equals  the  nominal  length  must  therefore 
be  specified  and  is  usually  taken  as  20°C  ()r68°F. 
At  25°C  the  length  of  a gage  which  is  one  inch  at 
20°C  is  about  1 .000  065  inches.  If  a gage  be  meas- 
ured at  the  higher  temperature  its  length  at  20'"C 
may  be  computed  if  the  expansion  coefficient  is 
known.  If  higher  precision  is  desired,  it  is  not  good 
policy  to  use  expansion  coefficients  given  in  tables 
because  our  measurements  show  that  the  expansion 
coefficients  of  steel  may  vary  from  0.000  0105  to 
0.000  0135  depending  on  its  hardness  and  com- 
position. 

This  variation  would  permit  an  unknown  steel 
gage  that  agrees  exactly  with  a standard  at  25°C  to 
differ  from  it  by  more  than  0.000  01  inch  at  20°C. 
If  the  unknown  piece  that  is  being  measured  is 
brass  or  some  other  matenal  having  an  expansion 
coefficient  that  differs  greatly  from  that  of  the 
standard  the  effect  of  temperature  change  is 
augmented.  From  these  considerations  it  is  evident 
that  to  measure  or  use  gages  with  an  accuracy  in 
tJie  millionth  place,  the  coefficient  of  expansion  of 
the  material  must  be  accurately  known,  and  also 
tempierature  controlled  and  measured  to  at  least 
0.1°C.” 

A 1-inch  micrometer  caliper  is  required  to  have  a 
maximum  error  in  indicated  reading  not  exceeding 
0.000  1 inch  and  a 12-inch  micrometer  caliper  not 
exceeding  0.000  3 inch.  If  the  standard  temperature 
were  23°  C (73.4°  F),  the  existing  1-inch  micrometers 
would  be  in  error  by  about  one-third  of  iheir  toler- 
ance while  the  12-inch  micrometers  would  be  in  error 
by  about  one  and  one-third  times  the  tolerance. 


’■'Thf  Development  of  Engineering  Metrology,”  by  F.  H. 
Rolt,  Institute  of  Production  Engineers,  1,  1952. 
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An  indication  of  the  impact  on  the  users  of  the 
thousands  of  precision  machine  tools  using  lead 
screws  presently  in  existence  can  be  made  by  con- 
sidering the  case  of  the  standard  leading  screw  lathe  m 
use  at  the  National  Physical  Laboratory  in  Great 
Britain.  The  60  inch  traverse  of  its  lead  screw  is  cor- 
rect to  within  0.000  10  inches  at  68°  F.  At  73.4°  F an 
additional  error  of  0.000  21  inches  would  be  in- 
troduced, for  a total  error  of  about  0.000  31  inches. 

In  1952,  Dr.  F.  H.  Rolt,  Superintendent  of 
Metrology  at  the  National  Physical  Laboratory'  had 
this  to  say  about  Great  Bntain’s  change  from  16-2/3° 
C to  20°  in  1931: 

“Previous  to  1931,  the  standard  temperature  for 
engineering  measurements  (the  temperature  at 
which  standard  length  gages  and  other  gages  arc  ad- 
justed to  size)  was 62  h ( 16-2/3°C)  in  Great  Britain, 
0°('  in  France  and  2()"C  in  some  other  European 
countries  and  the  United  States.  This  confused 
slate  of  affairs  was  abolished  in  April  1931  when 
the  International  Committee  of  Weights  and  Meas- 
ures adopted  a resolution  that,  in  future,  the  tem- 
perature of  20°C  (68° F)  should  be  universally 
adopted  as  the  normal  temp>erature  of  adjustment 
for  all  industrial  standards  of  length.  This  change 
was  supported  by  the  British  Standards  Institution 
and  put  into  effect  by  the  National  Physical  Labo- 
ratory at  the  beginning  of  1932.  It  amounted  to  a 
change  of  approximately  four  and  a half  ten- 
thousandths  in  the  length  of  a 12-inch  gage  and 
pro-rata  for  other  lengths.  In  other  words,  a 1 2-inch 
gage  which  had  been  true  to  size  at  the  old  tern- 
pierature  of  62°F  had  to  be  actually  shortened  by 
closely  0.000  45  inches  to  bring  it  true  to  size  at 
the  new  temperature  of  20°C. 

British  industry  weathered  this  change  without 
much  trouble  20 years  ago,  but  with  the  general  all- 
round improvement  in  accuracy  in  latter  years,  to 
effect  a change  of  that  magnitude  today  would 
bring  quite  a number  of  difficulties  in  its  train."^ 

For  many  years,  “°C”  has  stood  for  “degrees 
centigrade,”  the  well  established  temperature  scale 
devised  by  the  Swedish  Astronomer  Anders  Celsius, 
1701  to  1744.  In  keeping  with  the  practice  of 
honoring  certain  individuals  who  have  made  sig- 
nificant contributions  to  our  scientific  knowledge 
and  development,  by  renaming  units  after  them 
(e.g.,  “Hertz”  for  “cycles  per  second”),  the  use  of 
the  word  “Celsius”  over  “centigrade”  is  now  to  be 
preferred.  It  is  a fortunate  coincidence  that  both 
begin  with  the  letter  “C”. 
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10.  ADVISORY  INFORMATION  PERTAINING  TO 
DESCRIPTION  OF  ENVIRONMENTS 

10.1  DMcription  of  Environmtnts 

10.1.1  Thermal  Guidelines 

10. 1. 1. 1 Cooling  Medium.  For  most  conventional 
metrology  work,  the  appropriate  cooling  medium  will 
be  air  and  the  enclosure  will  be  a room,  in  a building, 
in  which  human  beings  are  occupied  in  daily  tasks. 
However,  in  some  cases  it  is  advisable  to  consider 
fluids  other  than  air  for  the  cooling  medium. 

Considerations  that  may  have  influence  in  choosing 
a fluid  other  than  air  for  the  cooling  medium  are 

(a)  Greater  heat  removal  capacity, 

(b)  More  accurate  temperature  sensing  and  control, 

(c)  Avoidance  of  contamination  of  parts,  espe- 
cially from  oxidation. 
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liolh  (a)  and  (h)  can  rcsnil  lioni  using  a ii(|iii(l 
lhal  has  the  grealci  dicclivcncss  as  a c(H»lanl.  Hie  el 
fcclivcncss  of  a ciMilanI  is  inca.su red  in  Icrnis  ol  a iilm 
cocfflcicnl  (/i;  Blu/hr-ll^-  F).  In  a spccilie  case  ol 
heal  flow  from  a surface  into  a fluid,  the  Him  co- 
efficient is  a rather  complicated  function  of  fluid 
properties,  flow  velocity,  and  geometry.  To  simplify 
estimating  the  relative  effectiveness,  air  and  water 
have  been  chosen  in  Figure  1 as  representative  of  all 
gaseous  and  liquid  coolants  respectively.  Rough 
boundaries  can  be  established  for  the  film  coefficients 
attainable  for  each  of  these  coolants  for  natural  and 
forced  convection,  as  is  shown  by  the  vertical  lines  in 
Figure  1. 

Tne  expected  film  coefficient  in  slowly  moving 
room  air  is  about  1.0.  This  can  be  increased  by  in- 
creasing the  velocity  of  the  air  up  to  a limit  at  about 
h = 10.0,  which  is  approximately  the  lowest  limit  for 


AIR:  WATER: 

1 i NATURAL  CONVECTION  1 I NATURAL  CONVECTION 

FORCED  CONVECTION  1 1 FORCED  CONVECTION 


h-BTU/HR-FT^-®F 


FIG  1 Coolant-effectiveness  chart  for  air  versus  water  in  natural  and  forced  convection  for  material  thickness  varying 
from  0.1  to  100  in.  The  solid  lines  separate  regions  of  part  and  coolant  dominance  for  iron  and  a typical  plastic. 
A condition  within  the  area  of  coolant  dominance  indicates  that  improvement  m the  control  of  the  part  tempera- 
ture can  be  achieved  by  increasing  the  flow  or  changing  the  coolant. 
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water  in  natural  convection.  Water  in  forced  convec- 
tion has  a potential  film  coefficient  of  several  hundred 
limes  lhal  of  room  air. 

The  total  resistance  to  heat  flow  from  a solid  wall 
into  a fluid  coolant  includes  the  thermal  resistance  of 
the  wall  material; 


(13) 


for  a wall  cooled  on  both  sides  and  heated  at  midplane ; 
and 


(14) 


for  a wall  heated  on  one  surface  and  cooled  on  the 
other. 

The  point  at  which  an  increase  in  the  film  coef- 
ficient begins  to  produce  diminishing  returns,  is  where 
the  internal  and  external  resistances  are  equal.  The 
diagonal  lines  on  the  chart  show  the  boundaries  of  this 
effect  for  different  wall  materials  and  one-sided  and 
two-sided  cooling.  The  chart  shows  that  for  one-sided 
cooling  of  iron,  the  forced  water  convection  is  fully 
effective  for  wall  thicknesses  well  over  1 inch;  while, 
for  plastics,  forced  water  convection  is  less  effective 
because  of  the  dominance  of  internal  resistance  for 
much  thinner  sections. 

10. 1. 1.2  Flow  Rate  and  Velocity.  The  flow  rate  of 
the  cooling  medium  is  of  prune  importance  in  the 
control  of  frequency  of  temperature  variation,  and 
tempierature  gradients.  Frequency  of  temperature 
variation  in  an  artificially  controlled  environment  is 
related  to  lags  and  delays  in  the  feedback  control  sys- 
tem and,  thus,  to  flow  rate  and  the  distance  between 
temperature  sensor  and  the  heating  and  cooling  sur- 
faces. Gradients  are  related  to  the  flow  rate,  the 
specific  heat  of  the  cooling  medium  and  the  magnitude 
of  heat  loads,  as  well  as  the  distribution  of  the  heat 
sources  in  contact  with  the  flow. 

In  general,  the  higher  the  flow  rate  the  higher  the 
frequency  of  temperature  variation  and  the  smaller 
the  temf>erature  gradients.  In  addition,  the  higher  the 
flow  rate  the  higher  the  velocity  of  the  cooling 
medium.  This  can  have  both  beneficial  and  detnmentaJ 
effects. 

The  beneficial  effect  of  higher  velocity-is  higher 
film  coefficients.  With  higher  film  coefficients,  a 
smaller  temperature  difference  is  required  to  remove 
heat  from  the  surface  of  an  object.  This  means  that 
objects,  with  either  internal  heat  sources  (e.g.,  motors 
inside  machine  frames)  or  receivmg  heat  by  radiation 
(e.g.,  from  electrical  lights)  will  have  tempieratures 


more  nearly  equal  to  that  of  the  cooling  medium  if 
the  velocity  is  increased. 

The  detrimental  effect  is  a tendency  to  discomfort 
human  personnel.  Where  human  operators  are  ex- 
pected to  work  in  rapidly  moving  air,  the  permissible 
velocity  is  limited  because  the  human  response  to  a 
given  dry-bulb  temperature  depends  on  the  air 
velocity  and  the  relative  humidity.  At  a dry-bulb  tem- 
perature of  68°  F,  a relative  humidity  of  50  percent, 
and  a velocity  of  100  fpm,  the  temperature  is  felt  as 
63°  F,  and  as  58°  F for  400  fpm  (see  Figures  2 and  3) 
The  maximum  permissible  velocity  for  human  com- 
fort in  a 68°  F,  50 percent  R.H.,  room  is  about  25  fpm. 

High  precision  metrology  laboratory  air  velocities 
range  from  6 to  20  fpm. 

10. 1. 1.3  Ranges  of  Frequencies  of  Temperature 
Variation  and  Limits  from  Mean.  The  dimensional 
response  of  an  object  to  ambient  temperature  varia- 
tion depends  on  its  length,  coefficient  of  expansion, 
and  time  constant  (see  3.2.5).  The  time  constant  of  an 
object  can  be  estimated  from 


time  constant  = t 


CV 

hA 


(15) 


where 


V = volume,  cu.  ft. 

A - surface  area,  sq.  ft. 
h = film  coefficient,  Btu/hr.  ft.^°F 
C = thermal  capacitance,  Btu/°F  ft^. 

Values  for  C are  approximate 
Iron,  Steel  ~ 54 
Aluminum  ~ 36 
Brass  ~ 48. 

Example: 

A steel  gage  block  1 inch  square  in  cross-section 
and  10  inches  long,  in  natural  convection  (estimate 
h = 2) 


T 


54(10) 

2 (42)  (12) 


0.53  hr. 


This  time  constant  is  the  time  the  gage  block  would 
take  to  reach  63.2  piercent  of  its  total  change  (see 
3.2.5).  For  example,  it  would  be  the  time  required  for 
the  object  to  change  temjjerature  0.632  degrees  after 
a step  change  in  environment  temperature  of  one 
degree. 

For  a 1 -degree  step  in  tempjerature  in  the  air 
around  the  gage  block  of  the  above  example,  the 
gage  eventually  changes  length  approximately  60 
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FIG.  3 Still-air  comfort  chart  of  the  American  Society  of  Heating,  Refrigerating  and  Air-Conditioning  Engineers 
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microinches.  But  it  takes  0.53  hour  (32  minutes)  to 
change  38  microinches.  This  slowness  of  response,  or 
thermal  inertia,  is  important  to  the  specification  of 
environments,  because  it  means  that  high  frequency 
temperature  variation  is  tolerable.  The  higher  the 
frequency,  the  more  tolerable  it  is. 

Experience  shows  that  most  machinery,  instrument 
stands,  etc.,  have  a limited  range  of  volume  to  surface 
area  ratio.  Quite  good  results  are  often  achieved  with 
a frequency  of  temperature  variation  (in  air)  of  1 5 to 
60  cycles  per  hour  and  an  amplitude  of  1 degree 
Fahrenheit.  For  the  gage  block  in  the  above  example, 
this  temperature  variation  would  cause  a length 
variation  of  less  than  1 microinch. 

Like  those  of  hi^  frequency  temperature  varia- 
tions, the  effects  of  very  low  frequency  temperature 
variations  are  not  significant  when  the  part  and 
master  have  closely  similar  dimensional  response. 

The  most  fortunate  case  possible  is  that  in  which 
the  part,  master,  and  comparator  (see  Section  20)  ail 
have  the  same  dimensional  response  characteristics. 
Then  no  temperature  variation  effect  is  significant.  In 
general,  however,  there  exists  an  upper  and  lower 
limit  of  frequency  between  which  is  a frequency  of 
maximum  differential  response.  Unfortunately,  it  is 
not  uncommon  that  gaging  systems  have  their  maxi- 
mum differential  response  at  a frequency  close  to  the 
natural  24-hour  day/night  cycle  period. 

Consequently,  it  is  usually  advisable  to  specify  the 
toierance-to-temperature  variation  in  terms  of  allow- 
able deviations  from  mean  temperature  which  vary  ac- 
cording to  the  frequency.  Closer  limits  should  be 
applied  to  low  frequency  components,  and  wider 
limits  may  be  permitted  for  high  frequency  com- 
ponents. 

10. 1. 1.4  Mean  Temperature.  Selection  of  a mean 
environmental  temperature  affects  the  cost  of  refriger- 
ation and  heating  equipment,  insulation,  and  flow  dis- 
tribution. 

Operation  at  a temperature  other  than  68°  F (20° 
C)  entails  consequences  in  the  form  of  potential  errors 
of  measurement  that  must  be  carefully  evaluated. 
Evaluation  procedures  are  described  in  Section  20. 

The  most  common  objection  to  operating  a room 
enclosure  at  68°  F,  other  than  the  cost  of  the  air  con- 
ditiorung  system,  is  a possible  discomfort  to  person- 
nel. As  discussed  in  Section  10.1.1.2,  a high  air 
velocity  can  cause  a sensation  of  much  lower  tem- 
peratures and  result  in  complaints.  In  order  to  main- 
tain human  comfort  without  a requirement  for 
special  clothing,  the  velocities  to  which  personnel  are 
subjected  should  be  less  than  20  fpm  to  avoid  the  sen- 


sation of  drafts.  Conventional  registers,  at  which  the 
velocities  may  be  800  fpm  or  more  are  not  satisfac- 
tory. Large  inlet  and  outflow  areas  are  recommended. 
Full-flow  ceilings  are  used  successfully  to  simul- 
taneously provide  high  flow  rate  and  low  velocity. 

In  cases  where  the  needs  of  measuring  equipment 
(68°  F)  and  human  personnel  (low  velocity)  cannot  be 
satisfied  simultaneously,  it  is  recommended  that  the 
equipment  environment  and  human  environment  be 
separated.  Use  of  special  air-flow  boxes,  liquid  baths, 
or  localized  high-velocity  air  showers  have  been  used 
successfully  for  this  purpose. 

10. 1. 1.5  Gradients.  Gradients  are  the  most  difficult 
of  all  non-ideal  temperature  conditions  to  assess  for 
possible  error  effects.  The  existence  of  gradients,  of 
course,  implies  that  portions  of  the  environment  will 
not  be  at  the  same  mean  temperature  so  that  the  con- 
sequences of  mean  temperatures  other  than  68°  F 
(20°  C)  will  be  different  in  different  locations  in  a 
room.  Movement  of  equipment  or  workpieces  from 
one  area  to  another  will  result  in  a change  in  the  error 
pattern. 

Machinery  is  affected  by  gradients  in  a variety  of 
ways.  For  example,  a machine  with  a high  vertical 
column  (r-motion)  where  the  z-motion  is  controlled 
by  a lead  screw  will  have  a progressive  error  if  there  is 
a high  vertical  temperature  gradient.  In  addition,  if 
the  vertical  slide  carries  a long  cantilever  arm,  the  arm 
will  undergo  a transient  change  of  length  when  raised 
or  lowered. 

Surface  plates  are  affected  by  vertical  gradients  in 
that  a temperature  difference  between  the  top  and 
bottom  of  the  plate  will  cause  the  plate  to  bend.  For 
solid  surface  plates,  the  amount  of  bending  or  out-of- 
flatness, 6,  IS  calculated  by  using  the  following 
formula: 


^ L^kAT 


(16) 


where 

L = length  of  the  surface  plate 
H = height'or  thickness  of  the  surface  plate 
Tu  = upper  surface  temperature 
Ti  = lower  surface  temperature 
K.  = coefficient  of  linear  thermal  expansion 
R = radius  of  curvature  of  the  plate. 


I Ar=7,-r, 


Machine  bedways  are  similarly  affected  by  both 
vertical  and  horizontal  gradients  which  cause  angular 
motions  (pitch,  roll  and  yaw). 
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Gradients  occur  because  of  heat  sources  that  exist 
within  the  boundaries  of  the  environment.  For  this 
reason,  it  is  difficult  to  administer  meaningful  re- 
quirements by  testing  in  the  absence  of  equipment 
and  personnel  that  shall  exist  under  normal  working 
conditions.  The  main  sources  of  heat  are  the  electrical 
lighting  fixtures,  electrical  and  electronic  equipment, 
motors,  and  people.  Room  enclosures  with  only  the 
electrical  lighting  fixtures  present  and  operating  have 
been  tested  with  an  observed  gradient  of  less  than 
0.1°  F per  foot  in  any  direction.  However,  the  same 
room  with  equipment  installed  normally  has  gradients 
of  over  0.2°  F per  foot  and  high  ^adients  of  several 
degrees  p)er  foot  near  the  surfaces  of  surface  plates, 
electronic  cabinets,  etc. 

As  mentioned  in  Section  10.1.1.2,  increasing  the 
flow  rate  will  decrease  the  gradients.  For  example,  sur- 
face plates  are  observed  to  have  temperatures  on  the 
upper  surfaces  of  2°  F or  more  above  the  local  mean 
in  a flow  rate  of  10  to  15  changes  per  hour  and  a 0.5° 
F or  less  in  100  changes  per  hour. 

10.1.2  Humidity.  In  certain  measurement  systems, 
a significant  error  can  occur  if  an  incorrect  value  for 
humidity  is  used  in  computing  a dimension.  For 
example,  in  the  measurement  of  the  length  of  gage 
blocks  by  interferometry,  a 10  percent  relative 
humidity  uncertainty  will  introduce  an  error  of  0.1 
microinch  per  inch  of  length.  Therefore,  in  labora- 
tories where  these  kinds  of  measurements  are  to  be 
made,  it  is  desirable  to  control  (and  measure)  the 
humidity  within  close  limits  to  keep  this  uncertainty 
small. 

There  are  three  basic  requirements  for  humidity 
control; 

(a)  To  provide  human  comfort; 

(b)  To  prevent  deleterious  effects  of  moisture  such 
as  corrosion  of  workpieces  and  measurement  ap- 
paratus, and; 

(c)  To  maintain  measurement  accuracy  of  work- 
pieces  that  are  dimensionally  sensitive  to  moisture. 

A discussion  of  the  latter  requirement  is  felt  to  be 
beyond  the  scope  of  this  standard  since  it  would  deal 
with  parameters  of  materials  that  are  not  directly  cor- 
relative with  the  guidelines  for  environmental  control 
of  dimensional  metrology  laboratories. 

Requirements  1 and  2 are  related,  but  are  almost 
diametrically  opposed.  Consequently,  there  have  been 
many  suggestions  given  as  to  what  limits,  if  any, 
should  be  placed  on  the  range  of  relative  humidities 
to  be  permitted  in  dimensional  metrology  enclosures. 

For  maximum  protection  against  corrosion  of  fer- 
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rous  components  of  measuring  instruments,  humidity 
should  be  maintained  at  very  low  levels.  However,  for 
the  maximum  comfort  of  personnel  in  a laboratory 
where  the  dry  bulb  temperature  is  maintained  at  68° 
F,  the  humidity  should  be  kept  at  a high  level.  The 
relative  humidity  recommended  is  a reasonable  com- 
promise between  these  two  extremes. 

Probably,  the  most  frequently  heard  value  for  the 
upper  limit  is  45  percent  relative  humidity.  A lower 
limit  is  then  selected  that  is  high  enough  to  afford  a 
certain  degree  of  personal  comfort,  but  low  enough  to 
not  economically  compromise  the  45  percent  upper 
limit. 

What  is  frequently  overlooked,  however,  is  that 
relative  humidity,  in  itself,  is  just  one  of  the  con- 
tributing factors  to  corrosion.  Of  almost  equal  im- 
portance are  the  constituents  of  the  atmosphere,  or 
cooling  medium,  in  which  the  workpiece  and  meas- 
uring apparatus  are  placed.  For  example,  the  presence 
of  certain  hygroscopic  salts  in  the  air  will  either  cause 
or  accelerate  the  corrosion  of  iron  exposed  to  the  air 
even  though  the  relative  humidity  is  relatively  low.  A 
saturated  solution  of  lithium  chloride  will  stand  in 
equilibrium  with  air  having  only  a 12  percent 
relative  humidity.  Similarly,  saturated  solutions  of 
either  calcium  chloride  or  magnesium  chloride  will 
stand  in  equilibrium  with  air  having  a relative  humidity 
of  31  or  33  percent  relatively.  Yet  iron  exposed  to  air 
containing  any  of  these  salt  solutions  will  corrode 
more  rapidly  than  if  they  were  not  present.  Again, 
iron  exposed  to  air  containing  ordinary  solutions  of 
sea  salts  shows  little  corrosion  at  a relative  humidiiy 
of  30  percent,  but  fairly  rapid  corrosion  if  the  air  has 
a relative  humidity  of  35  percent.  Salts  are  not  the 
only  corrosion-accelerating  agent  in  air,  so  far  as  iron 
is  concerned.  Small  traces  of  sulphur  dioxide  (a  com- 
mon constituent  of  industrial  and  urban  air)  will  ac- 
celerate corrosion  in  iron  at  ordinary  temperatures 
and  humidities. 

Probably  one  of  the  greatest  accelerators  of  corro- 
sion in  dimensional  metrology  laboratories  is  the  per- 
spiration residue  deposited  during  handling.  The 
chloride  ion  in  the  residue  is  probably  the  mam  ac- 
celerating agent,  although  the  fatty  acids  will  also  be 
a factor. 

Since  iron,  in  some  form,  is  the  most  common 
material  found  in  the  workpieces  and  measuring 
equipment  in  a dimensional  metrology'  laboratory,  the 
rest  of  this  section  will  deal  briefly  with  the  role 
humidity  plays  in  its  corrosion. 

Probably  the  most  exhaustive  and  definitive  labo- 
ratory studies  on  the  atmosphenc  corrosion  of  metals 
were  those  reported  by  W.  H.  J.  Vernon  in  England 
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shortly  after  World  War  I.  Briefly  stated,  these  studies 
showed  that  the  rusting  of  iron  in  air  was  not  neces- 
sarily associated  with  the  dew-point  as  had  been  sup- 
posed; but  instead,  a profound  increase  in  the  rate  of 
attack  was  identified  with  a critical  humidity  very 
considerably  below  saturation.  In  an  ordinary  room 
atmosphere  of  low  relative  humidity,  the  process  of 
rusting  is  influenced  entirely  by  the  suspended  par- 
ticulate impurities  in  the  atmosphere.  Consequently, 
screening  or  protection  of  the  surface  from  such  mat- 
ter could  arrest,  or  even  prevent  rust.  However,  even 
in  the  case  of  screened  or  filtered  air,  a primary  oxide 
film  will  form  even  with  relatively  low  humidities. 
The  so-called  “critical  humidity”  values  for  iron  are 
approximately  62  percent  and  82  percent.  These  are 
the  relative  humidity  values  at  which  profound  in- 
creases m corrosion  occur.  Vernon’s  studies  showed  a 
gradual  increase  in  corrosion  with  increases  in  relative 
humidity  from  0 percent  to  99  percent. 

Based  on  Vernon’s  studies  of  the  atmospheric  cor- 
rosion of  metals  and  the  studies  conducted  by,  or  for, 
the  U.S.  Navy  on  the  long-term  preservation  of  mate- 
rials (Operation  Mothball),  it  is  generally  accepted 
that  there  will  be  little  or  no  destmetive  corrosion  of 
metals  if  they  are  held  at  30  piercent  relative  humidity 
in  a reasonably  pure  atmosphere,  i.e.,  free  of  harmlul 
particulate  matter  such  as  .salts  and  sulphur  dioxide. 
By  using  protective  oils  or  greases  on  the  base  sur- 
faces, iron  can  exist  without  further  corrosion  at  a 
relative  humidity  of  45  picreent,  provided  the  surfaces 
to  be  protected  are  cleaned  as  thoroughly  as  possible 
to  elimmate  piossible  hygroscopic  dirt  particles  before 
the  protective  coating  is  applied. 

To  reiterate,  the  presence  of  moisture  is  essential 
for  natural  corrosion  to  take  place  at  normal  tempera- 
tures, presence  of  hygroscopic  matter  on  the  surfaces 
can  accelerate  the  normal  rate  of  corrosion;  and  the 
presence  of  certain  materials,  such  as  salts,  chloride 
ions,  and  fatty  acids  can  precipitate  corrosion  at 
relative  humidity  levels  well  below  saturation. 

An  upper  Limit  of  45  piercent  relative  humidity  has 
been  suggested  for  dimensional  metrology  laboratories 
provided,  of  course,  that  normally  bare  iron  surfaces 
are  clean  and  protected  with  some  typie  of  coating. 

10.1.3  Maintainabiliry.  Operating  and  maintenance 
procedures  must  be  promulgated  that,  if  followed,  will 
ensure  maintaining  tlie  performance  of  the  dimen- 
sional metrology  enclosure  within  its  specified  design 
limits. 

10.2  Testing 

The  purpose  of  this  section  is  to  give  users  of  this 
standard  some  understanding  of  the  practical  prob- 


lems that  exist  in  the  administration  of  the  require- 
ments outlined  in  Section  5.  Wherever  possible, 
specific  procedural  suggestions  are  made.  However,  a 
thorough  discussion  of  every  possible  instrument  or 
procedure  that  is  available  for  the  administration  of 
each  requirement  is  beyond  the  scope  of  this  docu- 
ment. 

It  is  strongly  recommended  that  every  specification 
include  a description  of  the  test  procedure  or  instru- 
ment that  is  intended  for  the  administration  of  each 
requirement.  Section  2 of  this  document  contains 
some  of  the  more  common  sources  of  information  on 
practical  procedures  and  instrumentation. 

10.2.1  Thermal  Guidelines 

10.2. 1. 1 Cooling  Medium.  Because  this  standard 
has  been  deliberately  kept  as  general  as  possible  in 
order  to  permit  the  use  of  a variety  of  cooling  media, 
there  is  little  that  can  be  discussed  here  beyond  that 
already  presented  in  Section  5.  The  user  of  this 
standard  is  cautioned  that  the  properties  listed  in  Sec- 
tion 5 are  only  those  that  pertain  to  the  thermal  be- 
havior of  the  cooling  medium.  For  specific  cases,  other 
properties  such  as  color,  opacity,  odor,  toxicity, 
acidity,  lubricity,  etc.  may  be  very  important. 

10.2.1.2  Flow  Rate  and  Velocity.  As  mentioned  m 
Section  10. 1. 1,  air  is  llie  most  widely  used  cooling 
medium  in  dimensional  metrology  laboratories  or 
enclosures,  althougli  the  possible  use  ol  a fluid 
medium  in  some  enclosures  cannot  be  overlooked. 

When  air  is  used  as  the  cooling  medium,  there  is  a 
tendency  to  have  it  flow  at  relatively  low  rates  to  pro- 
vide as  high  an  effective  temperature  as  possible  for 
the  occupants  of  the  laboratory  consistent  with  the 
68°  F design  spiecifi cation.  This  tendency,  aside  from 
the  effect  on  the  film  coefficients  discussed  in  Section 
10.1.1.1  and  10.1.1.2,  creates  problems  when  meas- 
urmg  the  air  velocity.  At  velocities  of  0 to  100  fpm, 
the  flow  pattern  is  frequently  very  unstable.  As  a re- 
sult, the  mass  turbulence  level  may  be  of  the  same 
magnitude  as  the  velcx:ity.  Consequently,  it  becomes 
imperative  that  any  instrument  used  be  proper!)’ 
calibrated,  and  the  using  personnel  be  aware  of  both 
the  limitations  of  the  instruments,  and  their  opera- 
tion. For  example,  several  types  of  thermal  ane- 
mometers (so-called  hot-wire  types)  can  be  used  in 
this  range;  but  the  accuracy  of  the  measurements  at 
the  lower  end  could  be  questionable,  even  though  thv. 
precision  of  the  measurements  is  quite  good  Another 
example,  non-directional  instruments  are  usually  un- 
able to  distinguish  between  large-scale  turbulence  and 
the  mass  velocity  of  air.  Tables  1 and  2 list  various 
types  of  instruments  commercially  available  to  meas- 
ure either  flow  rate  or  velocity. 
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The  Reynold’s  nun*  referred  to  in  Table  2 is  a 
dimensionless  param'  vti  used  to  designate  the  ratio  of 
the  inertia  forces  to  the  viscous  forces  in  a fluid 
motion  that  occurs  at  the  transition  from  laminar  to 
turbulent  flow. 

Measurements  made  using  the  kinds  of  instruments 
shown  in  Tables  1 and  2 are  frequently  made  either  in 
the  ducts  conveying  the  air,  or  in  close  proximity  to 
such  ducts.  It  should  be  recognized,  however,  that  this 
may  not  give  a complete  picture  of  the  actual  air 
changes  in  the  room  since  the  air  leakage  into  the 
laboratory  caused  by  wind  or  temperature  differences 
are  not  indicated  by  these  means.  Consequently,  if  a 
more  accurate  determination  of  the  total  change  time 
is  required,  it  mighi  be  necessary  to  go  lo  a measure- 
ment system  employii-.g  a thermal  conductivity  com- 
parator and  a fracei  ^ji'S.  In  this  system,  a known 
ar^ount  of  a tracer  ga*"  (usually  some  percent  of  the 
lOta'  air  volume^  is  released  into  the  room  and 
allowed  to  thoroughly  mix  with  the  air.  As  the 
release  occurs,  this  mixture  becomes  diluted.  The  con- 
ductivity comparator  is  then  used  to  measure  the  de- 
crease in  concentration  at  regular  time  intervals. 

The  Infiltration  can  then  be  calculated  from 

(17) 

where 

C=  concentration  after  r minutes,  percent 

Q,  = initial  tracer  gas  concentration,  percent 
k = infiltration  rate,  cubic  feet  per  minute 
v = volume  of  room,  cubic  feet 
c=  2.718. 

This  infiltralion  rale  can  then  be  used  to  correct 
llie  flow  rale  yielded  by  using  the  more  conventional 
iiist  rumenls 

10.2. 1.3  Ranges  of  Frequencies  of  Temperature 
Variation  and  Limits  from  Mean.  The  main  factors  to 
be  considered  in  choosing  an  instrument  or  instru- 
ments with  which  to  administer  temperature  variation 
requirements  are  the  frequencies  of  mterest  and  the 
cooling  medium.  The  instrument  chosen  must  have  a 
sensing  element  with  a time  constant  small  enough 
that  the  highest  frequency  of  interest  is  detected  and 
displayed  without  significant  attenuation  or  distortion. 

One  point  frequently  overlooked  is  that  a sensing 
element  may  have  a different  time  constant  for  each 
medium  it  is  in. 

Example: 

Bare  Thermistor 

Time  constant  in  air-3  minutes 

Time  constant  m liquid— 3 seconds 
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10.2. 1.4  Mean  Temperature.  Mean  temperature  is 
not  measured  directly  (see  5. 1.1. 4).  However,  the 
temperature  sensor-recorder  system  used  to  measure 
the  temperatures  from  which  the  mean  temjjerature  is 
calculated  must  have  adequate  sensitivity,  precision, 
and  accuracy  and  must  be  used  prop)erly  so  that  the 
calculated  mean  temperature  will  fall  within  acceptable 
confidence  limits. 

10.2. 1.5  Gradients.  The  effect  of  thermal  gradients 
can  best  be  measured  by  closely  monitoring  the  tem- 
perature of  the  master,  the  part,  and  the  comparator 
during  the  actual  measurement  and  applying  the  neces- 
sary thermal  differential  corrections  to  the  measure- 
mcnl  results. 

The  composition  and  flow  rate  of  the  cooling 
medium  should  be  monilored  for  continued  con- 
lormance  to  design  specifications. 

10.2.2  Humidity.  Humidity  is  to  be  measured  by 
any  method  having  sufficient  sensitivity  and  accuracy 
to  assure  the  basic  design  specifications  are  met. 

10.3  Operation  and  MaintenarKe 

10.3.1  Thermal  Guidelines 

10.3. 1. 1 Once  the  heat  transfer  into  an  enclosure 
has  been  established,  it  should  hold  fairly  constant  as 
long  as  the  physical  integrity  of  the  enclosure  is  not 
disturbed.  Some  long-term  shifts  due  to  aging  of  the 
materials,  such  as  the  wall  msulation,  may  be  ex- 
pected. Normally,  however,  this  should  not  pose  a 
serious  threat. 

Installation  of  heat-producing  sources  adjacent  to 
the  controlled  enclosure  should  be  avoided  il  at  all 
possible  because  ol  the  possible  effect  on  the  heal 
transfer.  II  a recalculation  of  the  heat  transler  should 
.show  a significant  change  that  could  affect  the  thermal 
stability  in  the  enclosure,  additional  insulation  may 
be  required. 

If  the  integrity  of  the  enclosure  is  maintained  and 
the  condition  of  the  filters,  the  lighting  system,  and 
the  air-conditioning  system  is  maintained  at  a suf- 
ficiently high  level  to  minimize  deviations  in  tempiera- 
ture,  cooling  medium  flow  and  velocity,  little  else 
should  be  required. 

10.3. 1.2  Flow  Rate  and  Velocity.  Periodic  main- 
tenance of  the  cooling  medium  distnbution  system  is 
normally  sufficient  to  maintam  the  established  cooling 
medium  flow  rates  and  velocities  provided  the  layout 
of  equipment  in  the  enclosure  has  not  been  sufficient- 
ly rearranged,  or  new  instruments  have  been  added 
that  could  disrupt  the  initial  cooling  medium  flow  pat- 
terns. 
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10.3. 1.3  Ranges  of  Frequencies  of  Temperature 
and  Variations  and  Limits  from  Mean.  The  only  wuy 
(or  llic  accTirucy  and  precision  ul  llic  temperature 
seiism)’  system  to  remain  within  the  sug^zesied  limits 
is  for  a regularly  scheduled  standardi/.alion  and/or 
calibration  program  to  be  established  and  followed. 

A periodic  maintenance  program  is  recommended 
for  the  temperature  control  system  for  the  enclosure 
to  assure  that  the  design  criteria  are  satisfied. 

10.3.1.4  Mean  Temperature.  If  the  procedures 
given  in  the  other  sections  of  10.3.1  are  followed,  the 
established  mean  temperature  should  be  maintained. 

10.3. 1.5  Gradients.  Because  of  the  difficulties  en- 
countered in  establishing  and  maintaining  thermal 
stability  in  a dimensional  standards  laboratory,  a 
program  of  continued  vigilance  to  ferret  out  causes 
of  instability  is  strongly  recommended.  This  is  par- 
ticularly important  during  the  periods  when  measure- 
ments are  actually  being  made. 

10.3.2  Humidity.  The  specified  humidity  limits 
should  be  maintained  by  any  suitable  means. 


20.  ADVISORY  INFORMATION  PERTAINING  TO 
THE  ASSURANCE  OF  ADEQUACY  OF  ENVI- 
RONMENTAL CONTROL 

In  this  section  it  is  assumed  that  the  measuring 
equipment  and  the  thermal  envirorunent  exist,  and 
that  normal  or  expected  operating  conditions  are  in 
force.  The  object  of  the  discussion  is  to  describe  the 
manner  ui  which  one  goes  about  determining  the  ex- 
tent of  measurement  errors  resulting  from  non-ideal 
temperature  conditions. 

The  ideas  and  methods  described  are  those  found 
in  fairly  common  usage  by  metrologists  everywhere. 
But,  for  the  first  time,  these  ideas  and  methods  are 
unified  and  formally  presented.  Some  of  the  concepts 
presented  may  at  first  app>ear  strange  and  unrelated  to 
previous  experience.  The  3-element  system  concept, 
for  example,  will  probably  fall  in  this  category.  How- 
ever, with  a little  patient  study,  the  concept  will  be 
seen  to  correspond  to  common  notions,  and  its 
utility  in  a disciplined  investigation  will  become  clear. 

The  other  notion  that  may  appear  to  be  new  is  that 
of  the  uncertainty  of  the  coefficient  of  expansion. 

Each  of  these  concepts  is  examined  and  reduced  to 
a practical  procedure  in  the  first  four  of  the  followmg 
paragraphs. 

The  last  paragraph  of  this  section  is  devoted  to  ex- 
plaining the  Thermal  Error  Index  and  its  use. 


20.1  Estimation  of  Consequences  of  Mean  Environ- 
mental Temperatures  Other  than  68  ' F 120  C) 

20.1.1  Length  Measurements.  The  as.sc.vsmcni  ol 
(lie  consequences  of  icinpcralurcs  olher  than  !• 

( 20"  (') are  easily  obtained  by  means  of  c(|ualioiis  ili.ii 
give  Ihe  Nominal  Diffcrcniial  Expansion  in  Icrni.s  ol 
the  Nominal  Expansions  of  the  part  and  master 

NDE  = (NE)p  - (NEU  (18) 

and 

NE  = xZ.  (T  - rj.  (19) 

Combining  these  equations,  we  get 

NDE  = KpL{Tp-  T,) 

= L[Kp{Tp-T,)-K„(Trr,-T,)]  ...  ‘ ^ 

Assuming  that  the  part  and  master  both  are  at  the 
mean  temperature,  Tp  = = T„g  (the  only  reason- 

able assumption  unless  thermometers  arc  attached  to 
both  the  part  and  master),  we  sec  that  the  error  is 
reduced  to  insignificance  if  Ihe  coefficients  of  thermal 
expansion  approach  equality.  And  this  is  true  even 
with  a large  deviation  of  the  mean  environmental  lem- 
pcratiire  from  68°  F (20°  C). 

Because  the  great  majority  of  manufactured  parts 
and  gages  arc  of  ferrous  materials  having  similar  cocl- 
ficients  ol  expansion,  many  industries,  particularly 
those  where  tolerances  arc  in  lens  of  thousandths  of 
inches,  have  successfully  functioned  without  concern 
over  the  effect  of  mean  environmental  temperature  on 
manufacturing  accuracy.  In  many  such  situations,  an 
arbitrary  insistence  on  68°  F (20°  C)  temperature  con- 
trol leads  to  unjustified  increased  cost  of  manufacture. 

As  tolerances  become  tigliter,  as  the  parts  become 
bigger,  and  as  the  materials  of  parts  and  masters  be- 
come more  dissimilar,  the  consequences  of  mean  en- 
vironmental temperatures  other  than  68°  F (20°  C) 
become  correspondingly  greater.  Here  it  is  to  be  noted 
that  in  recognition  of  the  possible  consequences  of 
mean  environmental  temperatures  other  than  68°  F 
(20  C),  it  is  not  uncommon  to  find  the  following  ac- 
tions in  use: 

(a)  Special  gaging  or  masters  made  of  nominally 
the  same  material  as  the  pans, 

(b)  Computation  of  corrections  which  arc  applied 
to  the  indicated  values  of  length.  The  required  com- 
putation method  is  derived  from  Equation  23.  The 
correction  is  set  equal  to  the  negative  of  the  Nominal 
Differential  Expansion. 

Correction  = -NDE  (21) 

Corrected  Length  = As-read  Length  + Correction.  (22 ) 
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As  (he  working  lolcrancc  decreases,  both  of  these 
procedures  fail  to  be  satisfactory  because  of  Ihe  mag- 
nitude of  the  Uncertainly  of  Nominal  Differential  Ex- 
pansion (see  20.2). 

20.1.2  Measurements  Other  than  Length.  Proce- 
dures and  fomiulae  for  the  assessment  of  the  effects 
of  mean  environmental  temperatures  other  than  68°  F 
(20°  C)  as  simple  and  straightforward  as  those  pre- 
sented in  the  preceding  paragraph  are  not  usually  pos- 
sible in  cases  other  than  length  measurements. 

For  example,  consider  the  case  of  an  iron  bedway 
casting  of  a machine.  Because  the  casting  may  have 
both  thick-  and  thin-walled  sections,  the  physical  com- 
position of  the  materia]  may  not  be  homogeneous,  re- 
sulting in  a non-uniform  coefficient  of  thermal  ex- 
pansion. The  magnitude  of  such  a variation  in  expan- 
sion coefficient  may  be  as  much  as  5 percent.  If  the 
non-uniformity  is  distributed  as  a vertical  gradient, 
raising  or  lowering  the  mean  temperature  will  result  in 
a bending  like  that  produced  by  a vertical  temperature 
gradient. 

This  effect  is  the  same  as  that  observed  m the  well- 
known  bimetal  strip,  and  can  be  called  a “bimetal  ef- 
fect”. 

The  bimetal  effect  in  structures  of  nominally  one 
material  is  relatively  small  compared  with  the  effect 
of  temperature  gradients.  For  example,  a base  casting 
like  that  mentioned  above  would  have  to  be  subjected 
to  a temperature  offset  of  20°  F before  the  bending 
approaches  that  induced  by  an  upper  and  lower  sur- 
face temperature  difference  of  only  1°  F.  However,  in 
structures  composed  of  two  or  more  greatly  dissimilar 
matenals  that  are  assembled  at  68°  F (20°  C),  the  bi- 
metal effect  can  be  quite  significant.  In  such  cases  the 
effect  of  mean  temperatures  other  than  68°  F (20°  C) 
can  be  properly  estimated  only  by  taking  into  account 
the  thermal  stresses  that  exist. 

Existence  of  severe  bimetal  effect  can  be  avoided 
only  by  strict  control  at  68°  F. 

Evaluation  of  the  effects  of  mean  tempieratures 
other  than  68°  F requires  that  the  net  effect  of  the  dis- 
tortions of  both  master  and  part  be  determined. 

20.2  Consequences  of  Uncertainties  of  Computations 

There  are  two  kinds  of  systematic  errors  that  occur 
when  the  effects  of  mean  temperatures  other  than 
68°  F(20°C)are  computed. They  are  the  errors  in  the 
values  of  the  temperatures  and  in  the  coefficients  of 
thermal  expansion  that  are  used  in  the  computations. 

Values  of  temperatures  used  in  computations  can 
be  in  error  because  of  defects  in  the  instruments  used 
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III  making  the  mcasurciiicnl.s  or  because  ol  llic  localioii 
al  which  the  meastireiiiciil  is  iiiaile.  I'oi  example,  the 
Ihcrmomctcr  ii.sed  may  Ik*  iiiacciiralely  ealibraleil  or 
have  a built-in  source  ol  error  such  as  the  sell-licalmg 
effect  found  in  resistance-bulb  thermometers.  Because 
of  the  self-heating  effect,  resistance-bulb  thermometers 
can  be  very  precisely  calibrated  in  liquid  baths  and 
give  erroneous  readings  on  metal  surfaces  or  in  air  be- 
cause the  heat  transfer  process  is  quite  different  in  the 
different  cases. 

Location  of  the  temperature-measurmg  probe  is  of 
significance  because  of  the  possible  gradients.  Use  of 
room  air  temperature  values  may  introduce  errors  of 
a degree  or  more.  Readings  of  direct-contact  probes 
are  more  reliable  but  are  still  subject  to  error  because 
of  gradients  within  the  object  whose  temperature  is 
being  measured.  An  effective  means  of  assessing  the 
validity  of  a given  location  is  to  compare  effects  of 
several  locations. 

The  approach  taken  in  formulating  the  standard 
procedure  for  estimating  the  effects  of  Uncertainty  of 
Nominal  Differential  E-ixpansion  is  to  require  that 
part  and  master  temperatures  be  measured  to  deter- 
mine worst-case  deviations  from  68°  F.  This  proce- 
dure, as  noted  in  6.2.1,  for  length  measurements, 
takes  into  account  the  effects  of  gradients  in  the  ap- 
paratus, as  well  as  in  the  room  in  which  it  is  located. 

If  part  and  master  temperatures  are  not  measured, 
the  estimation  of  the  consequences  of  uncertainties  of 
computations  must  include  consideration  of  the  un- 
certainties in  the  temperatures  used  in  computing  the 
estimation  of  the  effects  of  temperatures  other  than 
68°  F.  Equation  7 is  modified  as  follows: 

UNE  = (5 +0)(L)(/ -68)/100%  (23) 

where  d = At/t  - 68  X 100,  or  the  possible  percentage 
error  in  the  estimated  difference  between  the  part  or 
master  and  68°  F.  At  is  the  estimated  possible  error  in 
temperature  difference. 

With  proper  attention  to  the  simple,  well-estab- 
lished rules  of  precision  thermometry,  the  uncertain- 
ties due  to  temperature  measurement  can  be  easily 
reduced.  In  the  usual  case,  however,  the  effects  of  un- 
certainties of  coefficient  of  thermal  expansion  values 
are  much  more  difficult  to  overcome. 

Coefficient  of  thermal  expansion  data  are  published 
in  tables  in  many  handbooks  and  other  sources.  These 
values  cannot  be  used  without  consideration  of  their 
applicability,  i.e.,  their  uncertainty.  Uncertainties  in 
the  published  data  arise  because 

(a)  The  material  of  the  elements  of  the  measure- 
ment system-part  or  master  or  both-differ  from  the 
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material  for  which  the  data  are  given.  The  differences 
may  be  in  chemical  composition,  physical  composi- 
tion, or  both. 

(b)  The  published  values  are  usually  the  result  of 
averaging  data  from  several  experiments  and  from 
several  experimenters.  Consequently,  the  data  reflect 
the  effect  of  experimental  bias. 

(c)  The  published  values  are  valid  only  for  tem- 
peratures other  than  68°  F or  for  a range  of  tempera- 
ture other  than  that  of  the  computation. 

The  National  Bureau  of  Standards,  in  calibrating 
steel  gage  blocks,  assumes  an  uncertainty  of  the  coef- 
ficients of  expansion  of  ±5  percent  when  the  heat  and 
mechanical  treatment  of  the  steel  is  known.  The 
precision  of  the  coefficient  is  (I)  about  ±3  percent 
among  many  heats  of  steel  of  nominally  the  same 
chemical  content,  (2)  about  ±10  percent  among 
several  heat  treatments  of  the  same  steel,  and  (3)  about 
±2  percent  among  samples  cut  from  different  loca- 
tions in  a large  part  of  steel  that  has  been  fully  an- 
nealed. Hot  or  cold  rolling  will  cause  a difference  of 
about  ±5  percent. 

Other  materials  have  their  own  susceptibility  to  un- 
certainty of  coefficient  of  thermal  expansion,  depend- 
ing on  the  effects  of  chemical  contaminant  or  physical 
structure.  Some  materials  have  gram  structure  effects 
in  terms  of  expansion  coefficients  that  vary  with 
direction. 

The  typical  thermal  expansion  measurement  is 
conducted  with  an  apparatus  called  a dilatometer  m 
which  a specimen,  usually  rod  shaped,  is  heated  and  its 
change  of  length  measured.  Another  form  of  dila- 
tometer measures  change  of  volume  by  Archimedes' 
pnnciple,  resulting  in  a coefficient  of  cubical  expan- 
sion. For  homogeneous  (nondirectionally  sensitive) 
matenais,  the  coefficient  of  cubical  expansion  has  a 
value  three  times  that  of  the  coefficient  of  linear  ex- 
pansion. 

The  fact  that  the  typical  test  specimen  bears  little 
resemblance  to  real  parts,  with  consequent  uncertain- 
ties in  composition  and  treatment  not  reflected  in  ex- 
penmental  data  scatter,  suggests  that  decreased  un- 
certain ues  can  be  obtained  by  direct  measurement  of 
each  specific  object,  or  full-scale  dilatometry. 

Figures  4 and  5 represent  two  possible  ways  one 
may  find  thermal  expansion  data  presented  in  the 
literature.  Figure  4 is  a synthetic  case  deliberately 
oversimplified  for  the  purposes  of  this  discussion. 
Figure  5 is  an  actual  case.^  Note  that  Figure  4 is  a plot 


‘Data  courtesy  of  Richard  K.  Kirby,  U£.N.B.S.,  Thermal  Ex- 
pansion Laboratory 


temperature 

FIG.  4 Synthetic  Experimental  Results  of  Thermal  Expan- 
sion Measurements 


FIG  5 


of  change  of  length.  A/.,  as  a function  of  temperature 
where  AZ.  is  defined  as  zero  when  the  temperature  is 
68°  F.  This  is  the  usual  form  of  raw  data  from  dila- 
tomer  experiments. 


Figure  5 on  the  other  hand  is  a plot  of  the  mean 
(or  average)  coefficient  of  expansion  from  20°  C, 


Lt  - L-jo 

^ ' Z.20  (t-  20) 


(24) 


plotted  at  t.  The  data  for  t = 20°  C are  derived  from 
the  slope  of  the  thermal  expansion,  d at  that 

special  temperature. 

Figure  5 gives  results  from  several  investigators. 
Figure  4 shows  how  two  investigators  may  obtain  dif- 
fering results  that  are  reflected  in  Figure  5.  Both 
Figures  show  (1 ) the  scatter  of  experimental  data,  and 
(2)  the  nonlinear  nature  of  expansion  relative  to  tem- 
perature. Data  of  this  type  are  the  source  of  all 
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lahulalcd  coefficient  of  expansion  data.  The  pub- 
lished value,  however,  varies  according  to  how  the  ex- 
perimental data  are  interpreted.  For  a single  investiga- 
tion, the  value  depends  on  how  the  trend  is  inter- 
preted, i.e.,  how  the  average  curve  is  fitted.  For  mul- 
tiple investigations,  the  value  depends  on  how  the 
data  is  averaged. 

For  example,  published  values  for  pure  or  element 
aluminum  is  reported  as  23.6/*’  C at  20  C in  Metals 
Handbook  and  22.4/**  C at  20°  C in  Machinery’s  Hand- 
book.* Also,  in  Metals  Reference  Book,  Table  2,  the 
average  from  20°  C to  100°  C is  given  as  23.9/°  C;  and 
in  Metals  Reference  Book,  Table  1 , the  average  from 
0°  C to  100°  C is  given  as  23.5/°  C. 

20.3  Estimation  of  the  Consequences  of  Temperature 
Variation 

An  estimation  of  the  consequences  of  temperature 
variation  can  very  seldom  be  obtained  by  direct  cal- 
culation. Therefore,  the  procedures  described  in  this 
section  are  based  on  an  experimental  approach  to  the 
estimation. 

The  basic  experimental  procedure  used  in  the  esti- 
mation of  the  consequences  of  temperature  variation 
is  the  drift  test  which  is  described  in  20.3.1 . Drift  test 
results  can  be  interpreted  in  a variety  of  ways  to  ob- 
tain an  estimation  of  Temperature  Variation  Error. 
One  method  is  described  more  fully  in  20.3.2  along 
with  other  methods  of  interpreting  drift  test  results 
that  are  not  standard,  but  may  be  useful  because  they 
are  less  conservative  and  may  provide  development  of 
concrete  grounds  for  negotiating  the  acceptability  of 
thermal  effects  errors  in  special  cases. 

The  rationale  for  both  the  dnft  test  and  the  esti- 
mation of  Temperature  Variation  Error  is  given  in 

20.3.3  in  an  explanation  of  the  concept  of  the 
3-element  system. 

20.3.1  Drift  Test  Procedure 

20.3.1.1  Equipment.  The  object  of  a drift  test  is 
to  record  relative  displacement  in  a 2-element  system 
(see  Section  20.3.3).  TTie  most  direct  method  utilizes 
electromc  indicators  whose  output  is  recorded  on  a 
strip-chart  recorder.  Some  measurement  processes, 
such  as  the  measurement  of  flatness  with  an  optical 
flat  and  monochromatic  light  or  an  indicating  mi- 
crometer do  not  lend  themselves  to  the  use  of  auto- 
matic recording.  Therefore,  in  some  cases  it  will  be 
necessary  for  a human  operator  to  observe  the  drift 
and  record  numerical  values  and  corresponding  clock 
time.  These  data  can  be  subsequently  hand  plotted. 


•Calculated  from  12.44  Mm/in/°  F at  68°  F 
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it  is  Strongly  urged,  however,  that  wherever  pos- 
sible sensitive  electronic  indicators  and  strip-chart 
recorders  be  used. 

Though  a drift  test  can  be  performed  without  any 
necessity  for  knowledge  of  temperature  variation,  it  is 
often  advisable  to  record  one  or  more  temperatures 
either  for  use  in  later  correlation  of  two  drift  tests  or 
for  reference  if  temperature  variation  is  to  be  later  ac- 
cepted as  a method  of  monitoring  the  process  for 
validation  of  the  Temperature  Variation  Error  esti- 
mate. 

Just  as  in  the  case  of  displacement  measurements, 
it  is  strongly  urged  that  all  temperatures  be  automati- 
cally recorded.  For  this  purpose,  recording  resistance 
element  thermometers,  especially  those  with  ther- 
mistor sensors,  are  recommended. 

20.3. 1.2  Equipment  Testing 

20.3.1.2.1  Displacement  Transducers.  Aside  from 
the  usual  calibration  checks,  electronic  indicators 
should  be  checked  for  possible  sensitivity  to  the 
thermal  environment  in  which  the  drift  test  is  to  be 
performed.  An  “electronics  drift  check”  should  be 
conducted  by  blocking  the  transducer  and  recording 
the  output  for  at  least  the  same  period  of  time  as  that 
of  the  drift  check  to  be  performed.  “Blocking”  a 
transducer  is  to  make  it  effectively  indicate  on  its  own 
frame,  base,  or  cartridge.  Figure  7 shows  a cartridge- 
type  linear  variable  dificrcntial  transformer  blocked 
by  means  of  a cap  or  capture  device  which  holds  the 
indicator  armature  in  a fixed  position  relative  to  the 
cartridge. 

During  the  electronics  dnft  check,  the  entire  dis- 
placement recording  system  should  be  located  as 
nearly  as  possible  as  it  will  be  during  the  drift  test. 

Electronics  drift  tests  have  been  useful  in  proving 
that,  in  many  cases  where  electronic  indicators  have 
been  the  suspected  source  of  drift,  they  were  innocent 
and  the  real  cause  was  thermal  drift.  The  commercial!) 
available  cartndge-type  LVDT  gage  heads  have  been 
proven  many  times  to  be  especially  free  from  drift. 

20.3.1.2.2  Temperature  Recording  Systems.  The 
temperature-measunng  and  recording  apparatus  should 
be  thoroughly  tested  for  calibration,  response,  and 
drift. 

Resolution  of  at  least  0.1°  F is  recommended.  Time 
constants  of  sensing  elements  of  about  3 minutes  are 
recommended  for  air  temperature  sensors,  30  seconds 
for  liquid  and  surface  temperature  sensors.  Air  probes 
must  be  shielded  from  possible  radiation  effects. 

20.3. 1.3  Preparation  of  System  for  Test.  An  es- 
sential feature  of  the  feature  of  the  dnft  test  is  that 
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FIG.  6 Effect  of  uncertainties  of  coefficients  of  expansion 
on  permissible  tolerances.  Part  nominal  size  of  L 
with  tolerance  ±AL.  Tolerance  is  reduced  to  ±AL' 
when  mean  temperature  is  T ± AT. 
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cunditiuns  during  the  test  must  duplicate  the  normal 
conditions  for  the  process  as  closely  as  possible. 
Therefore, before  the  test  is  started,  nomial  conditions 
must  be  determined.  The  step-by-step  procedure  lol- 
lowed  in  the  subject  process  must  be  followed  in  the 
same  sequence  and  with  the  same  timing  in  the  drift 
test.  This  is  especially  important  in  terms  of  the  ac- 
tions of  human  operators  in  mastering  and  all 
preliminary  setup  steps.  With  as  little  deviation  from 
normal  procedure  as  possible,  the  displacement  trans- 
ducers should  be  introduced  between  the  part  (or 
master,  depending  on  the  type  of  drift  check)  and  the 
rest  of  the  C-frame  such  that  it  measures  relative  dis- 
placement along  the  line  of  action  of  the  subject  meas- 
urement process. 

The  temperature-sensing  pickup  must  be  placed  so 
as  to  measure  a temperature  which  is  correlatabie  with 
the  drift.  Some  trial  and  error  may  be  necessary.  In 
the  extreme  case,  temperature  pickups  may  have  to  be 
placed  to  measure  the  temperatures  ol  all-of  the  active 
elements  of  the  measurement  loop. 

20.3.1.4  Representative  Time  Period  for  a Drift 
Test.  Once  set  up,  the  drift  test  should  be  allowed  to 
continue  as  long  as  possible,  with  a minimum  of 
deviation  from  normal  operating  conditions.  In  situa- 
tions where  a set  pattern  of  activity  is  observed,  its 
duration  should  be  over  some  penod  of  time  dunng 
which  most  events  are  repeated.  When  a 7-day  work 
week  is  observed  in  the  area,  and  each  day  is  much 
like  any  other,  a 24-hour  duration  is  recommended.  If 
a 5-day  work  week  is  observed,  then  either  a full- 
week  cycle  should  be  used  or  checks  performed  during 
the  first  and  last  days  of  the  week. 

20.3. 1.5  Postcheck  Procedure.  After  the  drift  test, 
the  displacement  transducers  and  the  temperature 
recording  apparatus  should  be  restandardized. 

20.3.1.6  Example  Drift  Test  Results.  Figures  8 and 
9 are  results  from  drift  tests  conducted  on  a mcasunng 
machine/gage.  Figure  8 is  the  drift  recorded  over  a 
24-hour  period  for  a system  consisting  of  the  master 
and  comparator.  Figure  9 is  the  drift  recorded  over  the 
succeedmg  24-hour  pieriod  for  a system  consisting  of 
the  part  to  be  measured  and  the  comparator.  In  both 
cases,  ambient  temperature  at  a point  near  the  gage 
was  recorded  and  is  plotted  in  the  corresponding 
figures. 

20.3.2  Temperature  Variation  Error.  Figure  10 
shows  the  results  of  both  part/comparator  and  master/ 
comparator  drift  tests  for  a real  measurement  process 
In  this  case,  ambien.  temperature  readings  were  ob- 
tained simultaneously  with  each  drift  test  for  the  pur- 
pose of  approximating  the  proper  phase  relationship. 
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FIG  10  Results  of  part/comparator  and  master/comparator  drift  tests  of  a gage  m an  Inspection  Shop  Tests  were 
conducted  on  successive  days.  The  data  are  supenmprosed  on  clock  tune 


TTie  two  sets  of  data  were  superimposed  on  a basis  of 
clock  time,  which  appears  to  give  a good  overall  agree- 
ment in  ambient  temperature  variation. 

The  ambient  temperature  variation  on  the  two  suc- 
cessive days  has  a well-defmed  24-hour  component 
with  an  amplitude  of  about  1.5  F.  Superimposed  on 
this  are  higher  frequency  components  with  periods  of 
from  '/^  to  l*/i  hours.  From  these  data  it  is  possible  to 
compare  the  24-hour  cycle  characteristics  because  of 
the  repeatability  of  the  environment  at  this  frequency ; 
but  phase  relationships  at  the  higher  frequencies  arc 
not  discernible  because  of  nonrepeatability. 

At  the  24-hour  frequency,  the  master/comparator 
and  part/comparator  drift  curves  are  in  phase  and 
have  very  nearly  the  same  amplitude.  This  is  a classic 
example  that  shows  the  importance  of  measuring 
cycle  time  because  the  larger  amplitudes  of  drift  are 
associated  with  the  low  frequency,  whereas  the  smaller 
amplitudes  of  drift  are  associated  with  the  higher 
frequencies. 

For  short  measurement  cycle  times,  say  I hour,  the 
procedure  for  evaluating  Temperature  Variation  Error 
given  in  Section  20.3.1  results  in  a TVE  = 60fiin.  For 
measurement  cycle  times  of  12  hours  or  more  the 
TVE  = 1 20^  in. 


When  the  quality  of  the  drift  data  permits,  it  is 
sometimes  possible  to  apply  the  more  precise  evalua- 
tion methods  discussed  in  Section  20.3.3  which  are 
less  conservative.  In  the  example  of  Figure  10,  little  is 
gained  by  this  procedure  because  the  maximum  dif- 
ference between  the  two  drift  curves,  which  corre- 
sponds to  the  possible  error  for  short  measurement 
cycle  times  is  still  about  60  microinches.  This  is 
probably  because  of  nonrepeatable  components  of 
temperature  variation  in  the  two  days  testing.  The  day 
on  which  the  mastcr/coniparator  drift  test  was  per- 
formed appears  to  have  had  more  severe  high 
frequency  temperature  components.  This  discrepancy 
appears  to  exaggerate  the  true  part/master  relative 
drift.  Further  drift  tests  to  obtain  results  for  more 
consistent  temperature  variations  would  be  advisable 
in  this  case  if  Temperature  Variation  Error  is  the  major 
thermal  effect  in  this  measurement  process. 

20.3.3  The  3-Element  System  Concept.  The  mag- 
nitudes of  the  effects  of  temperature  variation  are  de- 
pendent on  the  structure  of  the  measurement  ap- 
paratus and  not  only  on  the  size  and  composition  of 
the  part  and  master  as  was  true  in  the  previous  sec- 
tions. Also  unlike  the  other  components  of  thermal 
error.  Temperature  Variation  Error  depends  on  the 
work  habits  of  the  person  making  the  measurements. 


26 


AMERICAN  NATIONAL  STANDARD 
TEMPERATURE  AND  HUMIDITY  ENVIRONMENT 
FOR  DIMENSIONAL  MEASUREMENT 


ANSI  B89  6.2  19/3 


FIG.  1 1 The  three  elements  of  a length-measuring  system. 


One  of  the  simplest  structures  is  that  encountered 
in  the  measurement  of  the  length  of  an  object  with  a 
gage  block  and  a column  comparator.  Figure  1 1 shows 
a schematic  representative  of  such  a system.  As  can  be 
seen,  it  consists  of  a part,  a master  (the  gage  block) 
and  a comparator.  Thus,  the  system  consists  of  three 
elements. 

In  Figure  11,  each  element  is  shown  to  have  a 
charactcnstic  length;  P = part  length,  M = master 
length,  and  C = comparator  length.  In  the  measure- 
ment process,  C is  first  set  equal  to  M,  then  P is 
checked  to  see  if  F = C. 

If  there  were  no  tempierature  variations,  the  meas- 
urement process  could  be  straightforward.  However, 
because  of  temperature  vanations,  heat  is  constantly 
being  exchanged  between  the  three  elements  and  the 
ever-changing  environment. 

If  the  time  constants  of  all  three  elements  are  not 
the  same,  they  will  respond  to  temperature  variations 
such  that  it  would  be  possible  that  all  three  elements 
will  never  simultaneously  have  the  same  temperature. 
And  even  if  the  time  constants  were  all  the^ame,  and 
their  temperatures  always  equal,  they  may  not  have 
the  same  length,  except  when  all  are  at  68°  F (20°  C), 
because  of  different  coefficients  of  expansion. 

For  each  element,  its  time  constant,  length  and  co- 
efficient of  expansion  defines  its  dimensional  response 


to  temperature  variation. 

Figure  12  shows  the  dimensional  response  of  the 
three  elements  of  Figure  1 1 for  an  assumed  sinusoidal 
ambient  temperature  vanation.  For  simplicity,  the 
hypothetical  system  consists  of  three  elements  of  the 
same  material  but  different  time  constants,  the  largest 
being  that  of  the  master,  the  smallest  being  that  of  the 
part  with  the  time  constant  of  the  comparator  between 
those  of  the  other  elements. 

As  can  be  seen,  the  result  is  that  the  3-dimensional 
responses  differ  in  amplitude  and  phase.  It  should  be 
noted  that  dimensional  response  data  in  this  form  is 
rarely  obtainable,  because  it  requires  the  use  of  an  in- 
depiendent  apparatus  that  must  itself  be  unaffected  by 
temperature  variation. 

The  data  of  Figure  12,  if  it  were  obtainable,  can 
easily  be  interpreted  for  an  estimate  of  the  Tempera- 
ture Variation  Error.  It  is  only  necessary  to  consider 
the  effect  of  the  measurement  cycle  as  follows. 

Suppose  that  at  time  T„ , the  comparator  is 
mastered.  The  act  of  making  C and  M equal  causes  the 
dimensional  response  curve  of  the  comparator  to  be 
shifted  parallel  to  itself  (the  comparator  is  “zero 
shifted”)  as  shown  by  the  dashed  curve.  If  the  part  is 
checked  without  delay  after  mastering,  it  is  found  to 
be  too  large  by  the  amount  q.  If,  instead,  the  part  is 
checked  much  later,  say  at  time  7,^,2,  the  part  will  be 
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FIG.  12  Sample  steady-state  dimensional  response  of  a 3- 
element  system  to  a sinusoidal  ambient-tempera- 
ture variation 


found  to  be  too  small  by  the  amount  r.  If  the  com- 
parator is  remastered  at  time  7’^2i  the  comparator 
curve  is  again  shifted,  resulting  in  new  magnitudes  of 
possible  error. 

Because  Temperature  Variation  Error  results  from 
the  variation  of  the  differences  of  the  charactenstic 
lengths,  it  is  p>ossibie  to  separate  the  3-element  system 
into  two  2-element  subsystems.  For  example.  Figure 
13  shows  the  two  curves  that  result  when  the  com- 
parator variations (c)  are  subtracted  from  the  part  and 
master  dimensional  responses  {P-C  and  M-C).  These 
data  might  have  been  obtained  by  recording  the  out- 
put of  an  electronic  indicator,  such  as  is  found  used 
on  modern  column  comparators,  when  the  part  and 
master  are,  successively,  in  the  comparator  with  the 
indicator  contacting  the  part  and  master,  respectively. 
Data  such  as  this  are  the  result  of  drift  tests.  In  the 
next  section  detailed  procedures  will  be  given  for  the 
conduct  of  drift  tests  followed  by  a discussion  of 
methods  of  interpreting  drift  test  data  to  obtain  an 
estimate  of  Temperature  Variation  Error. 

The  main  problem  in  interpreting  such  data  results 
from  the  fact  that  it  is  not  possible  to  conduct  simul- 
taneous part  comparator  and  master/comparator  drift 
tests.  Consequently,  additional  data  is  required  to 
determine  the  proper  phase  relationship  between  the 
two  recorded  drift  curves,  or  the  pxissible  con- 
sequences of  unknown  phase  relationship  must  be 
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considered  in  the  estimate  of  Temperature  Variation 
Error. 

Because  the  data  of  Figure  13  liave  been  con- 
structed from  the  data  of  Figure  12,  no  phase  uncer- 
tainty exists  and  the  Temperature  Variation  Error  can 
be  extracted  easily.  For  example,  for  a mastering 
cycle  occurring  between  times  r^i  and  T,f,i  and  a 
measurement  of  the  part  without  delay,  the  possible 
error  q is  simply  the  difference  between  the  two 
curves. 

The  effect  of  mastering  is  to  estabhsh  a new  base- 
line for  the  part/comparator  drift  curve  (P-C).  This 
new  baseline  is  shown  in  Figure  13  as  the  line  (0-0). 
If  the  measurement  of  the  part  takes  place  at  time 
the  resultant  error  isr  as  determined  previously 

If  a scries  of  like  parts  urc  inspected  between  times 
and  T^i,  the  consequences  of  Tempxiraturc 
Variation  Error  range  from  +r/  to  r. 

In  the  case  that  the  clock  times  at  which  mastering 
occurs  are  unknown  and  unpredictable  and  the  meas- 
urement cycle  time  is  very  short  (mastering  with  each 
measurement  and  negligible  delay  before  the  part  is 
inspiected),  the  pxissible  Temperature  Variation  Error 
is  ±x,  or  the  maximum  difference  between  the  two 
drift  curves  at  any  given  time.  Because  of  the  short 
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FIG.  13  Relatisie  drift  components  for  a 3-element  system 
(same  example  as  m Figure  11).  P-C  is  the  relative 
drift  between  the  part  artd  the  comparator,  and 
M-C  IS  the  relative  drift  between  the  master  and 
the  comparator. 
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FIG.  14  Schematic  of  setup  used  to  measure  part  on  a gage 
' with  a lead-screw  master. 


FIG.  15  Schematic  of  setup  used  to  measure  part  on  a gage 
with  a lead-screw  master.  The  measuring  sequence 
is  a change  from  (a)  to  (b). 


eye  which  is  assumed  to  have  no  effective  dimensional 
response  to  ambient  temperature  variation. 

In  length-measuring  processes,  however,  a 3-cicMicnt 
system  is  always  found.  For  example,  consider  the 
cases  shown  in  Figures  14  and  15.  The  former  is  the 
case  of  a measuring  machine  or  machine  tool  with  a 
leadscrew  serving  as  master.  In  Figure  15,  the  meas- 
urement process  is  shown  to  consist  of  changing  from 
position  (a)  to  position  (b).  The  analogy  between  this 
case  and  the  simple  3-element  system  of  Figure  1 1 is 
seen  if  it  is  realized  that  in  the  two  configurations,  the 
comparator  is  composed  of  a portion  of  the  lead- 
screw,  the  nut  and  table  support  for  the  part.  These 
elements,  though  appearing  to  change,  remain  in  a 
structural  loop,  while  the  part  and  master  exchange 
places  as  members  of  the  loop. 

The  case  shown  in  Figure  16  is  that  of  a 1-inch 
indicating  micrometer  used  as  a comparator.  The 
master  is  a gage  block.  Figure  17  shows  the  same 
micrometer  used  to  measure  the  part  without  check- 
ing zero.  In  this  case,  the  micrometer  frame  plus 
screw,  opened  to  the  size  of  the  part,  constitutes  the 
master.  The  same  structure  also  fulfills  the  function 
of  comparator. 

In  Figure  IK  still  the  same  micrometer  is  brought 
to  its  null  position  and  a zero  correction  is  made  be- 
fore the  part  is  measured.  In  this  case  the  master  is 
that  portion  of  the  screw  that  is  withdrawn  to  make 
room  for  the  part.  The  rest  of  the  micrometer  forms 
the  comparator. 

Consider  now  a 2-inch  indicating  micrometer  and 
the  following  case.  The  part  is  \ inches  in  diameter. 


measuring  cycle  tune  the  comparator  is  slaved  to  the 
master  so  that  the  comparator  contributes  nothing  to 
the  error.  The  error,  therefore,  is 

iP-Q  - (Af-C)  = P-M. 

This  error  is  dependent  only  on  the  difference  between 
the  master/compiarator  drift  and  the  part/comparator 
drift  and  the  clock  time  at  which  the  measurement  is 
made.  If  the  measurement  cycle  time  is  longer  than 
the  period  of  the  temperature  oscillation,  the  maxi- 
mum possible  error  is  ±y,  or  the  maximum  difference 
between  the  two  drift  curves  regardless  of  time. 

Note  thaty  is  slightly  larger  than  x. 

In  some  dimensional  measurement  processes  the 
3-element  system  reduces  to  a 2-element  system.  For 
example,  the  process  of  measuring  flatness  with  an 
optical  flat  under  monochromatic  light,  is  a case  of  a 
2-element  system.  The  comparator  here  is  the  human 
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A 1-inch  gage  block  is  used  to  master  the  micromelcr. 
The  master  in  this  case  is  the  gage  block  plus  that 
portion  of  the  screw,  approximately  i^-inch  long, 
which  is  withdrawn  to  make  room  for  the  part  (see 
Figure  19). 
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The  last  four  cases  show  how  the  master  and  com- 
parator can  be  changed  by  changes  in  the  operating 
procedure. 

20.4  Consequences  of  Temperature  Gradients 

Effects  of  gradients  in  mean  environmental  temper- 
ature are  usually  accounted  for  in  the  case  of  length 
measurements  under  effects  of  temperatures  other 
than  68°  F or  under  considerations  of  uncertainties  of 
temperature  measurements.  Consequently,  the  main 
concern  here  is  the  effect  on  measurements  other  than 
length  such  as  a measurement  of  flatness.  An  example 
of  the  estimation  of  the  effect  of  temperature  gradient 
on  a measurement  of  flatness  is  given  in  Section  10.1. 

To  satisfy  the  intent  of  the  Thermal  Error  Index, 
computation  of  an  estimate  of  the  consequences  of 
uncertainties  of  computations  as  discussed  in  Section 
20.2  must  be  performed  and  added  to  the  estimation 
of  the  consequences  of  temperature  gradient  and  the 
consequences  of  temperature  variation  (Section  20..'^). 

20.5  Thermal  Error  Index 

This  standard  does  not  rccoiiimciid  values  lor  the 
Thermal  Error  Index.  Such  values  cannot  be  stated 
without  regard  to  other  sources  of  error  in  the  meas- 
urement process.  For  example,  a Thermal  Error  Index 
of  10  percent  assigns  to  thermal  effects  that  fraction 
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of  the  working  tolerance  that  is  usually  considered  to 
include  the  composite  effects  of  all  error  strurccs.  In 
given  cases,  the  permissible  values  depend  on  the 
degree  of  control  that  is  maintained  over  all  aspects  of 
the  measurement  process,  including  the  skill  level  of 
personnel.  In  a machine  shop,  a value  of  0.1  may  be 
justifiable  while  in  a metrology  laboratory'  it  may  be 
possible  to  increase  the  value  to  0.2. 

The  main  objective  of  the  Thermal  Error  Index  is 
to  convey  the  quality  of  a measurement  process  with 
respect  to  thermal  effect.  As  such,  it  is  mainly  an  ad- 
ministrative topi. 

It  is  to  be  noted  that  one  way  to  reduce  a Thermal 
Error  Index  is  to  increase  the  working  tolerance.  Con- 
sequently, it  serves  as  a feedback  device  to  inform 
management  and  designers  of  the  degree  of  absurdity 
of  a specified  tolerance.  The  Thermal  Error  Index  does 
nothing  more  than  estimate  the  maximum  possible 
error  caused  by  thermal  environment  conditions  af- 
fecting a particular  measurement  process.  It  does  not 
establish  the  true  magnitude  of  error  in  any  measure- 
ment. It  serves  to  remove  doubt  about  the  existence 
of  errors  and  to  establish  a system  of  rewards  and 
penalties  to  processes  that  are  combinations  of  tech- 
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niques  and  conditions,  some  good  and  some  bad. 

A Thermal  Error  Index  evaluation  penalizes  a 
measurement  process  on  three  counts. 

(a)  Existence  of  temperatures  other  than  68°  F 

(b)  Existence  of  temperature  variations 

(c)  Existence  of  temperature  gradients 

The  same  evaluation  rewards  good  techniques  by 
decreasing  the  Thermal  Error  Index  for  (I)  attempt- 
ing a correction  for  the  consequences  of  temperatures 
other  than  68°  F,(2)  keeping  environmental  variations 
to  a minimum,  and  (3)  maintaining  acceptable  tem- 
perature gradients.  The  act  of  pierforming  the  evalua- 
tion results  in  the  knowledge  of  what  techniques  or 
conditions  can  be  changed  to  achieve  the  greatest  im- 
provement with  the  least  effort.  For  example,  if  Tern- 
pierature  Vanation  Error  is  found  to  be  the  greatest 
source  of  error,  the  measurement  cycle  time  may  be 
reduced  such  that  the  Thermal  Error  Index  is  reduced 
to  an  acceptable  value.  TTius,  by  more  frequent  master- 
ing, at  some  nominal  increase  in  opierating  expense, 
possible  misapplication  of  capital  to  improve  tem- 
perature control  IS  avoided. 
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9.14  ERROR  BODGETS 


Robert  R.  Donaldson,  Project  Leader 
Large  Optics  Diamond  Turning  Machine  Project 
Labfrence  Livermore  National  Laboratory,  Livermore , California 


INTRDDDCTION 

Generally  speaking,  an  error  budget  is  a systems  analysis  tool,  used  for 
prediction  and  control  of  the  total  error  of  a system  at  the  design  stage  for 
systems  where  accuracy  is  an  important  measure  of  performance.  Given  a 
system-error  goal,  an  error  budget  can  be  used  in  a control  mode  to  set 
Individual  subsystem  error  limits,  while  also  making  trade-offs  that  balance 
the  level  of  difficulty  among  the  subsystems.  In  a predictive  mode,  proposed 
subsystem  design  can  be  assessed  for  error  contributions,  leading  to  a 
predicted  overall  system  error.  Typically  the  predictive  and  control  modes 
are  iterated  repeatedly. 

A significant  break-point  occurs  when  the  required  subsystem  error  limits 
exceed  the  state  of  the  art.  Within  the  state  of  the  art,  the  error  budget 
can  be  used  as  an  aid  in  minimizing  the  overall  system  cost.  Beyond  the  state 
of  the  art,  the  trade-off  alternatives  are  those  of  accepting  a less  stringent 
system-error  goal  or  accepting  the  time  and  cost  required  for  the  i^cessary 
improvements  in  the  state  of  the  art.  Obviously  the  larger  the  required 
improvements  the  more  speculative  the  development  process  becomes,  but  the 
error  budget  remains  useful  as  an  assesanent  tool. 

To  the  author's  knowledge,  error  budgets  have  not  been  used  in  the  design 
of  machine  tools  beyond  the  example  to  be  presented  later  in  this  article,  and 
hence  the  subject  is  not  well  developed.  The  following  secticxi  contains  the 
general  approach  applied  to  the  example;  suggested  areas  for  further 
de^'&'lypmen,:^^ e given  at  the  end  of  the  article. 


MACHINE  TOOL  ERROR  BUDGETS 


BASIC  ASSUMPTICNS 

Two  basic  assumptions  underlie  the  use  of  an  error  budget  for  a machine 
tool.  The  first  is  that  the  instantaneous  value  of  the  total  error  in  a 
specified  direction  is  the  sum  of  all  the  individual  error  components  in  that 
direction  (i.e.,  linear  superposition  is  valid).  The  second  is  that  the 
individual  error  components  have  physical  causes  that  can  be  isolated  and 
controlled  or  measured  to  allow  reduction  or  prediction  of  the  error 
magnitude.  Both  assumptions  are  supported  by  the  discipline  of  machine  tool 
metrology,  which  provides  methods  for  the  measurement  of  individual  errors,  as 
discussed  in  Sec.  7.0. 

ERROR  BUDGET  PLOW  CHART 

Figure  9.14-1  shows  the  overall  process  of  generating  an  error  budget, 
illustrated  for  a two-axis  lathe,  frcm  the  physical  sources  of  error  at  the 
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FIG.  9.14-1  F1c3w  chart  for  generating  an  error  budget  for  a two-axis  lathe. 
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left  to  the  errors  of  the  tforl^ieee  at  the  right.  The  following  paragraphs 
win  elaborate  on  the  ▼arious  stages;  underlined  teras  are  defined  in  the 
sentences  in  which  they  first  appear. 

B^BOR  SOORCES,  COUPLDIG  AliD  DISPLACQIENT  ERRORS 

The  displacement  errors  are  the  distances  between  the  surfaces  of  an 
actual  and  an  ideal  (perfect)  workpiece.  The  displacement  errors  are  always 
measured  in  the  sensitive  direction,  i.e.,  normal  to  the  ideal  wort^iece 
surface.  It  is  useful  to  note  that  ev^  for  a general-purpose  machine  tool 
intended  for  m«iy  part  shapes,  the  sensitive  directions  may  be  restricted — 
e.g.,  for  a lathe,  the  1-Z  (slide  axis)  plane  containing  the  spindle 
centerline  is  the  plane  of  all  sensitive  directions  during  cutting,  and  hence 
cemparable  displacement  errors  in  the  Y direction  are  nonsensitive,  being 
tangent  to  the  worJ^iec#  sittface. 

^ err Of  source  is  the  physical  cause  of  a displacement  error,  and  a 
coupling  mechanim  is  the  physical  factor  that  connects  the  two.  Error 
sources  need  only  be  as  fundamental  as  is  useful,  i.e.,  surface  finish  can  be 
degraded  by  seifflic  ground  motions  which  can  be  further  explained  by  study  of 
the  earth  soirees,  but  some  knowledge  of  the  amplitude  and  frequency  of  the 
seismic  motions  is  sufficient.  In  this  exmaple,  reducing  the  resulting 
displacement  error  to  an  acceptable  level  dep^ds  entirely  on  the  design  or 
selection  of  adequate  vibration  Isolators  for  the  coupling  mechanism.  This 
example  also  illustrates  that  tl^  ^upling  mechanisn  is  in  general  a trwsfer 
function  in  the  dyn^ic  syst«  sense.  The  transfer  function  may  range  frem 
elementary  to  very  coeplex.  For  exaa^le,  slideway  positioning  error  due  to 
Abbe  offset  (perpendicular  distance  from  the  cutting  tool  to  the  line  of 
action  of  the  position  measuring  syst^)  has  angular  motion  of  the  slideway  as 
the  error  source  and  the  offset  distance  as  the  coupling  mechanism,  making  the 
transfer  fvmction  a simple  multiplier.  At  the  other  extreme,  room- temperature 
variations  as  am,  error  souroe  have  a complicated  time-history  effect  on 
tool-to-wor iqjiece  displacement  errors. 

There  are  two  difficult  points  in  dealing  with  the  error  sources  in  an 
error-budget  analysis.  The  first  is  generating  a oomplete  list  that  does  not 
omit  any  significant  sources.  Here  the  past  e;q>erience  of  those  compiling  the 
list  is  the  primary  factor?  there  is  no  kno%m  test  for  completeness.  The 
second  area  of  difficulty  is  in  assessing  magnitudes,  both  for  the  error 
sourc»  and  for  the  displac^ent  error  resulting  from  the  source  and  the 
coupling  mechanism.  Ideally  one  would  prefer  to  have  oomplete  detail  on  the 
displacement  errors  Ej^,  including  their  variation  within  the  machine  %#ork 
zone  and  with  time.  However,  it  is  unreasonable  at  the  design  stage  to  expect 
more  than  a peak- to- valley  envelope  bound  on  1^,  together  with  some 
approximate  knowledge  of  the  fr^uency  of  veiriation  (temporal  or  spatial) 
within  the  envelope.  Magnitude  estimates  should  be  supported  by  calculations 
wherever  possible?  these  may  ruige  frem  simple  or der-of -magnitude  estimates 
(e.g.,  temperature  stability  of  0.Q1®C  means  a steel  bar  (a  ■ 11.5  x 10“® 
per  ®C)  of  1 m length  will  change  in  length  by  0.115  um,  to  computer-based 
finite-element  calculations  of  structural  defamations  under  load.  Some 
magnitudes  can  only  be  estimated,  such  as  the  deformation  of  the  workpiece  by 
the  clamping  fixtures  or  the  wear  of  the  cutting  tool. 

It  is  worth  noting  that  the  machine  tool  designer  is  usually  faced  with  a 
problan  of  divided  responsibility  in  oonstructing  an  error  budget,  unless  a 
complete  turnkey  facility  is  being  provided  for  machining  specified 
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vorl^ieces.  If  the  user  locates  the  machine  in  a poorly  controlled  thermal 
environment,  or  if  the  machine  tool  is  general  purpose,  and  hence  to  be  used 
with  a wide  variety  of  workpiece  shapes,  materials,  fixtures,  and  cutting 
tools,  the  error  estimation  process  becomes  more  difficult.  Nevertheless,  it 
is  recommended  that  all  error  sources  be  included  that  influence  the  final 
irarkpiece  accuracy.  If  desired,  the  final  result  can  be  recomputed  with 
various  assumpti^s  regarding  those  error  sources  having  divided  responsi- 
bility, to  determine  the  sensitivity  of  the  total  error  to  these  assumptions. 

WORKPIECE  ERROR  CATEGORIES 

Considering  a circular  cylinder  as  a simple  but  specific  example  of  a 
workpiece,  it  is  clear  that  there  can  be  several  workpiece  error  categories, 
such  as: 

• Size  (diameter,  length). 

• Form  (roundness,  straightness,  end  flatness) . 

• Surface  Finish  (side  or  end,  with  or  across  lay). 

Since  different  error  sources  may  produce  displacement  errors  E^^  that 

fall  into  different  workpiece  error  categories,  A,  B or  C,  in  Fig.  9.14-1,  it 
is  important  to  choose  categories  that  are  meaningful  for  the  intended  end  use 
of  the  workpieces  if  possible  (again  raising  the  probl^  of  divided 
responsibility).  Note  that  the  categories  given  can  be  separated  according  to 
the  spatial  frequency  of  veiriation  along  the  workpiece  surface,  with  average 
size  error  being  a "dc"  (zero  frequency)  term,  surface  finish  having  the  nest 
rapidly  varying  spatial  frequency  and  form  errors  being  in  between.  When 
dealing  with  error  sources  having  a temporal  frequency,  it  is  necessary  to 
determine  the  spatial  frequency  that  will  result  on  the  workpiece  surface  by 
use  of  typical  machining  parameters.  For  example,  a lathe  spindle  turning  at 
1200  rpm  (20  rps)  with  a feedrate  of  0.15  mm/rev  will  yield  a feed  speed  of 
3 nn/s.  If  surface  finish  is  considered  to  consist  of  wavelengths  shorter 
than  0.75  on  adong  the  workpiece  surface,  then  the  tanporal  frequency  in  the 
surface-finish  category  will  be  higher  than  (3  nan/sec) / (0. 75  ran),  or  4 Hz; 
lower  frequencies  will  contribute  to  form  errors.  Increasing  (or  decreasing) 
the  spindle  speed  or  feedrate  per  revolution  will  increase  (or  decrease)  the 
transition  frequency  of  4 Hz.  Since  any  given  source  Sj^  may  cause  a 
displacement  error  Ej^  in  more  than  one  workpiece  error  category,  each 
possibility  should  be  examined. 

ERROR  DIRECTIONS 

After  generation  of  a list  of  displacement  errors  in  each  category,  it  is 
preferable  to  separate  these  into  error  directions  along  the  machine  tool  axes 
(X  and  Z for  a lathe.  Fig.  9.14-1).  In  the  surf ace- finish  category,  this  may 
not  be  feasible,  since  many  of  the  sources  are  vibrational,  and  it  is 
difficult  to  predict  the  direction  of  vibration  in  a complex  machine  tool 
structure.  The  reconnended  method  is  to  estimate  a maximvai  amplitude  and 
assume  it  to  be  omnidirectional. 

COMBINATORIAL  RULE 

Given  the  displacement  errors  by  category  and  direction,  the  next 
question  is  what  combinatorial  rule  to  use  in  combining  them  into  a single 


displacement  error.  If  the  set  of  errors  had  oooplete  detail » direct  addition 
could  be  used  to  generate  a map  of  the  resultant  displacement  error  as  a 
function  of  slideway  position,  time,  etc.  In  the  more  probable  case  of  no 
detail  exoept  an  upper  bound  for  the  magnitude  of  each  error,  the  selection  of 
a combinatorial  rule  Is  more  difficult.  The  end  use  of  the  woricpiece  is  also 
a factor  in  the  selection  process.  In  sene  applications  an  averaging  process 
occurs,  making  an  rms  error  amplitude  meaningful,  while  in  others,  the  largest 
isolated  error  peak  is  crucial,  regardless  of  the  perfection  of  the  remaining 
surface.  In  the  first  case  a statistical  treatment  is  obviously  indicated. 

In  the  latter  extreme,  a conservative  approach  is  to  sun  the  individual 
displacement-error  amplitudes  arithmetically.  However,  this  approach  may  be 
extremely  conservative,  due  to  the  very  low  probability  of  all  N errors  being 
at  a maximum  simultaneously;  statistics  can  also  aid  in  assessing  the 
probability  of  exceeding  sene  submaximun  amplitude. 

The  rms  error  amplitude  RMS^ot  **  individual  errors  of  varying  rms 
amplitudes  RM5^,  providing  the  individual  errors  are  uncorrelated,  is  simply 
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(1) 


Use  of  Bq.  (1)  requires  an  rms  amplitude  for  each  displacenent  error, 
whereas  the  preceding  discussion  has  used  a total  or  peak- to- valley 
amplitude  (separation  of  two  parallel  lines  containing  the  error 
signal) . The  two  amplitudes  are  connected  by  an  equation  of  the  form 

PVi  ■ K • RMSi  , (2) 


where  K is  a numerical  factor  depending  on  the  probability  distribution 
of  the  error  signal  between  the  bounding  lines.  The  values  of  K for 
three  distributions — a pure  sinusoid,  a signal  with  uniform  probability 
density,  and  ±2-sigffia  Gaussian — are  2.83,  3.46  amd  4.0  respectively. 
Unless  more  detailed  information  is  available,  the  middle  case  is 
reconsnended  (K  ■ 3.46).  Individual  error  traces  are  typically  not 
Gaussian,  although  they  may  show  some  central  tendency,  causing  the 
uniform  density  assumption  to  be  somewhat  conservative;  in  any  case  the 
other  two  values  of  K differ  only  by  about  ±20%.  The  result  is  then 
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tot 
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(3) 


Bq.  (3)  can  be  applied  in  Fig.  9.14-1  to  error  amplitudes  to 

to  yield  E;^,  and  so  on  for  E^j'  «tc. 


WORKPIECE  ERROR 


Given  the  resultant  displacement  error  by  direction  for  each 
workpiece  error  category,  the  workpiece  error  of  Fig.  9.14-1  can  be 
predicted  in  each  category  from  knowledge  of  the  workpiece  geometry, 
i.e.,  the  sire  and  shape  as  shown  on  an  engineering  drawing.  For 
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workpiece  surfaces  having  a slope  angle  ^ with  respect  to  the  X axis,  the 
formula  for  the  error  normal  to  the  surface  in  category  A is 

Ea4)  - [(Eax  oos  4»)2  + (e^2  » (4) 

and  similarly  for  other  categories.  Bg.  (4)  describes  an  ellipse  with  major 
and  minor  values  of  and  £^^2"  ^AX  ^AZ  equal,  the  ellipse  is  a 
circle  and  the  error  is  can i directional.  If  the  error  is  not  omnidirectional 
and  the  workpiece  contains  a continuously  varying  contour,  Bg.  (4)  can  be  used 
to  calculate  the  error  at  selected  points  along  the  contour  for  the  purpose  of 
estimating  an  average  error.  For  cases  where  the  workpiece  geometry  is 
unknown,  this  section  can  be  omitted. 


ERROR  BUDGET  FOR  THE  lARGE  OPTICS  DIAMOND  TURNING  MACHINE 


BACKGROUND 

A properly  sharpened  natural  diamond  cutting  tool  will  cut  in  exact 
accordance  with  its  edge  location  and  can  produce  a mirror  finish  on  a variety 
of  materials  if  the  machine  tool  has  a suffici^tly  low  vibration  level.  This 
has  created  interest  in  the  use  of  machine  tools  to  fabricate  reflective  metal 
optics.  While  it  offers  the  possibility  of  radically  aspheric  shapes  that  are 
not  reasonable  to  produce  by  conventional  optical  figuring  and  polishing 
methods,  it  also  requires  accuracies  that  are  10-100  times  more  stringent  than 
those  usually  expected  of  precise  machine  tools.  Efforts  in  this  direction 
have  progressed  to  the  point  that  diameters  below  0.5  m can  be  diamond- turned 
to  figure  accuracies  of  the  order  of  100  nm  (4  yin.)  rms  euid  diameters  up  to 
2 m done  for  accuracies  of  the  order  of  250  nm  (20  yin.)  rms.  Interest  in 
accuracies  down  to  13  nm  (0.5  yin.)  in  sizes  up  to  1.5  m led  to  a study  for  a 
new  machine,  known  as  the  Large  Optics  Diamond  Turning  Machine.  Because  the 
achievement  of  these  goals  would  require  a major  effort,  development  of  an 
error  budget  was  made  a part  of  a preliminary  design  study.  Due  to  time 
constraints  on  subsequent  design  and  construction,  improvenents  in  the  state 
of  the  art  were  limited  to  moderate  extensions  by  methods  reasonably 
well-defined  at  the  outset. 

An  overall  view  of  the  above  machine  is  shown  in  Fig.  9.14-2.  The  design 
and  the  error  budget  evolved  by  mutual  interaction;  space  does  not  permit  a 
full  description  of  the  process  or  of  the  resulting  design.  However, 

Fig.  9.14-2  illustrates  several  features: 

• Use  of  symmetry,  such  as  a vertical  spindle  axis  (gravity  along 
workpiece  centerline)  and  a bridge  design  for  increased  rigidity. 
Symmetry  causes  several  error  sources  to  be  self -cancelling  (zero 
coupling) . 

• Interferometric  tool-path  measurement,  with  interferometer  beams 
contained  in  evacuated  telescoping  tubes. 

• Metrology  frame,  a structure  kept  free  of  variable  loads  to  serve  as  a 
measurement  reference  datum. 

Other  features  will  be  noted  in  discussing  the  various  error-budget  entries. 

Two  workpiece  error  categories  will  be  presented,  surface  finish  and 
radial  figure  error.  A wavelength  of  0.1  mm  (0.004  in.)  was  chosen  as  the 
transition  between  the  two.  For  a finishing  cut  feedrate  of  4 ym/rev  and 
100  rpm,  the  associated  time  is  15  s.  For  the  optical  systems  in  question,  an 
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rms  error  amplitude  Is  meaningful  and  was  used  in  both  categories. 

Displacement  errors  %«ere  estimated  as  peak- to- valley  amplitudes  and  the 
uniform  probability  density  assumption  leading  to  Bg.  (3)  was  employed. 

SURFACE-FINISH  ERROR  BUDGET 

Surface  finish  is  degraded  by  a variety  of  sources,  many  of  which  are 
difficult  to  quantify.  For  this  reason  the  entries  in  Table  9.14-1  are 
largely  derived  from  experience  and  are  treated  as  omnidirectional. 

The  first  four  error  sources  in  Table  9.14-1  are  sources  of  vibration 
excitation.  External  mechanical  disturbances  come  frcaa  the  fact  that  the 
pneumatic  isolators  transmit  seme  fraction  of  seismic  disturbances  and 
building  vibrations  to  the  machine,  as  do  various  electric  and  fluid  power 
lines.  Room  noise  is  also  an  excitation  source;  a machine  room  with 
soiuid- insulated  walls  is  required.  Hydraulic  vibration  refers  to  noise 
created  by  flow  of  teaper at ure-contr oiled  liquids  through  or  over  the  machine 
to  maintain  a stable  temperature  field.  The  spindle  drive  entry  is  similar  to 
the  first  category,  but  refers  to  excitation  from  the  floor-mounted  motor 
being  transmitted  by  a low-influence  drive  coupling.  Imperfect  spindle  air- 
pressure  regulation  will  cause  the  spindle  faceplate  to  rise  and  fall;  the 
entry  shown  corresponds  to  0.03%  change  in  gage  pressure  for  time  periods 
shorter  than  15  s.  Theoretical  finish  is  the  height  of  the  scallop-shaped 
cuts  caused  by  the  finite  ad«rance  per  revolution  of  a round-nosed  cutting  tool 
and  is  one  of  the  few  entries  that  can  be  calculated.  In  fact,  the  magnitude 
was  chosen  to  be  equal  to  the  other  smaller  entries,  leading  to  the  feedrate 
quoted  in  the  earlier  calculation  of  the  15  s transition  time  (assianing  a 
0.75-niB  (0.30-ino)  tool  radius).  The  estimate  for  imperfections  from  the  tool 
edge  and  the  cutting  mechanics  is  based  on  experimental  data  frem  the 
literature.  The  resolutiOT  of  the  control  system  becomes  significant  when 
approaching  tangency  to  one  axis.  The  servo-controlled  tool  mount  is  a 
low- amplitude,  high-bandwidth  position  servo  mounted  on  the  lower  end  of  the 
tool  bar,  driven  by  the  position-loop  error  signals  of  the  main  slideways;  the 
entry  represents  a combination  of  the  tool  mount  resolution  and  the  accuracy 
of  its  position  measurement  sensors.  The  last  two  entries  in  Table  9.14-1  are 
associated  with  the  interferometers.  The  first  applies  to  the  distance 
interferometers,  and  is  a consequence  of  imperfect  beam-splitting  of  the 
two-frequency  laser  beam,  causing  a cyclic  displacement  error  once  per 
wavelength  (633  nm) . The  last  applies  to  the  straightness  interferometers, 
which  operate  in  still  air  at  1 atm  and  are  subject  to  any  difference  in  index 
of  refraction  caused  by  pressure  or  temperature  differences  between  the  two 
equal-length  measurement  arms;  the  estimate  is  based  on  experimental  data. 

Performing  the  root-sum-square  operation  of  Bq.  (3) , the  rms  value  is 
found  to  be  4.2  nm  or  42  A (0.17  yin).  This  result  is  somewhat  smaller  than 
is  typically  observed  on  existing  diamond  turning  machines,  especially  larger 
machines,  but  is  larger- than  the  best  achievements  on  smaller  machines,  which 
approach  10  A rms;  hence  the  result  is  achievable  in  principle. 

The  numerical  results  of  Table  9.14-1  can  be  used  to  illustrate  a feature 
of  rms  error  amplitude  when  the  individual  amplitudes  are  comparable,  that  the 
total  increases  approximately  as  N^/^  (exactly,  if  all’  amplitudes  are 
equal).  Adding  emother  entry  of  average  size  4 nm  (0.16  yin.)  increases  the 
calculated  result  by  about  4%  to  44  A,  as  does  multiplying  by  (12/11)^/^ 

» 1.04.  Thus  the  consequence  of  overlooking  an  independent  error  of  a typical 
magnitude  is  not  serious  if  N is  reasonably  large.  Axx)ther  feature  of  rms 
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9.14‘>1  Surface-finish  error  budget 


Peak-to-Valley 

amplitude 

Error  source  nm  (yin.) 


1. 

External  mechanical  disturbances 

5.0 

(0.20) 

2. 

Airborne  noise 

2.5 

(0.10) 

3. 

Hydraulic  vibration 

2.5 

(0.10) 

4. 

Spindle  drive 

2.5 

(0.10) 

5. 

Spindle  air  pressure 

2.5 

(0.10) 

6. 

Theoretical  finish 

2.5 

(0.10) 

7. 

Tool-edge/cutting  mechanics 

4.0 

(0.16) 

8. 

MQJ  resolution 

5.0 

(0.20) 

9. 

Servo-controlled  tool  mount 

10.0 

(0.40) 

10. 

Interf ercmeter  phase  distortion 

2.5 

(0.10) 

11. 

Index  difference-straightness 
interferometer 

3.5 

(0.14) 

Sum  of  squares 

« 215.75  (0 

.3452) 

rms  value  (Bq.  3)  ■ 4.2  nm  (0.17  yin.) 

or  42  A rms 
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errors,  the  tendency  of  the  larger  entries  to  dominate  the  results,  can  also 
be  shown  from  Table  9.14-1.  If  entry  9 (10  ran)  had  been  omitted,  the  result 
would  drop  by  about  25%  to  31  A;  if  entry  9 were  increased  to  20  ran,  the  new 
result  would  becone  66  A,  over  50%  larger. 

RADIAL  PIGDRB-ERROR  BUDGET 

Figure  error  along  a radial  path  is  distinguished  from  azimuthal  figure 
error  (along  a circular  path  around  the  axis) , the  latter  being  caused,  for 
example,  by  errors  in  the  spindle  truth  of  rotation.  Figure  errors  are 
distinguished  from  surface-finish  errors  by  spatial  wavelengths  longer  than 
0.1  nn  (0.004  in.)  or  temporal  frequencies  lower  than  1/15  Hz. 

Table  9.14-2  shows  the  various  sources  of  radial  figure  error  and  the 
associated  amplitudes  in  the  X and  Z directicxis,  which  will  be  discussed  in 
turn. 

The  interferometric  measurement  of  position  is  fundamentally  limited  by 
the  stability  of  the  laser  frequency.  The  error  magnitude  corresponds  to  a 


TABLE  9.14-2 

Radial  figure  error 

budget. 

Peak-to*valley  magrutudes 

EiTor  x}i«ce 

X-dsection 
nm  (Min.) 

Z-direction 
nm  (mui,) 

Nation  interferometers 

Limt  centni  frequency 

Index  of  refnction 

Optical,  etectrontc  factors 

3,0  (0.12) 
3.0(0.12) 

SjG  (0 JO) 

5.5  (0.22) 

5 J (0.22) 
5.0(0.20) 

Straightness  interferometers 
ftth  length  difference 

Optical  flat  difference 

Index  difference 

Reviution-metrology  frame  drift 

3,7  (0.15) 

15.0  (0.60) 

3J  (0.14) 

3.7  (0.15) 
15.0(0.60) 

3.5  (0.14) 

6.3  (0.25) 

Control  system 

Scrvo-conoolled  tool  mount 

lO.O  (0.40) 

10.0  (0.40) 

Tempmture  control 

Metrology  structural  loop 

Sptndle  growth 

Workpiece  thamai  boundary  layer 

10.0  (0.40) 

30.4  (1J2) 

7J  (0.30) 
40.0  (1.60) 
34.4  (1.38) 

Spindle  air  supply  pressure 

— 

7.5  (0.30) 

GfavTtaoonai  loading 

5j0  (OJO) 

— 

Barometric  pressure 

4.0  (0.16) 

5.0(0.20) 

Nonmachme  factors 

Tool  nose  roundness 

Workpiece  fixture  distortion 

Workpiece  body  forces 

Workpiece  mternal  unbalance 

Workpiece  readuaJ  soess 

13i)  (OJO) 
75i)(3jOO) 
25.0(1.00) 

25  J)  (1.00) 
25.0(1.00) 

13.0(0.50) 
60.0(2.40) 
20.0  (0.80) 
20.0  (0.80) 
20.0  (0.80) 

Sum  of  n^uares 

9128  (14J0) 

8207  (13.13) 

rms  values  (Eq.  1-2) 

27.6  nm  (1.10  mia.) 

26.1  nm  ( 1.05  Min.) 
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drift  of  5 parts  in  10^;  this  value  is  veil  vithin  the  state  of  the  art  for 
laboratory  lasers  using  iodine~cell  stabilization r but  is  more  stringent  than 
the  3 parts  in  10*  for  oomnercially  available  heterodyne  lasers  and  hence 
assumes  either  further  local  development  or  a reduction  to  ccanercial 
practice.  The  difference  in  the  numerical  values  for  X and  Z come  from  the 
maximum  difference  in  arm  lengths,  which  is  anjd.ler  for  X even  though  it  has  a 
larger  travel,  because  of  the  synnetric  arrangement  of  beam  paths.  The 
variation  of  the  index  of  refraction  within  the  beam  path,  also  5 parts  in 
10*,  can  be  achieved  by  maintaining  a vacuum  in  the  beam  tubes  between  1 and 
15  millitorr.  The  optical  and  electric  factors  include  items  such  as  beam 
collimaticxi  and  spatial  filtering,  siirror  scatter  and  non-flatness , etc., 
which  tend  to  produce  poorly  defined  fringes,  plus  detector  noise,  amplitude 
sensitivity  and  electronic  jitter;  the  amplitudes  are  estimates. 

Figure  9.14-3  shows  a schematic  diagram  of  the  straightness 
interferometer  for  the  X axis.  As  noted  earlier,  the  straightness 
interferometers  operate  in  a still-air  enclosure  with  arm  lengths  that  are 
nominally  equal;  errors  can  be  caused  by  actual  differences  in  arm  length  due 
to  inaccurate  systen  setup,  or  air  currents,  etc.,  that  cause  index 
differences  between  the  two  arms.  Since  the  beams  traverse  the  two  optical 
flats  as  the  X-position  changes,  differences  in  flatness  cause  errors.  This 
error  is  very  sensitive;  the  amplitudes  given  correspond  to  measurement  of  the 
flatness  differences  to  eUhout  4 nm  (1/6  yin.},  with  storage  and  subsequent 
recall  from  a microprocessor  memory.  The  geometry  of  the  arrangement  shown  in 
Fig.  9.14-3  is  also  sensitive  to  slight  rotations  of  the  metrology  frame;  a 
scheme  for  measuring  such  rotations  using  the  difference  of  the  upper  and 
lower  interferometer  readings  is  resolution-limited  by  the  amount  shown. 

The  only  long-term  control-systan  error  is  the  residual  error  of  the 
servo-controlled  tool  mount,  which  as  noted  earlier  is  driven  by  the  error 
signals  of  the  main  axis  drives.  The  error  magnitudes  shown  are  based  on 
resolution  and  linearity  error  of  the  tool  mount  displacement  sensors. 

The  metrology  structural  loop  will  be  temperature  stabilized  by  a large 
flow  of  water  within  m enclosing  shroud  (not  shown  in  Fig.  9.14-2);  the 
magnitudes  shown  are  calculated  frcm  an  ability  to  measure  and  control  the 
incoming  water  temperature  to  1.1  x 10"*®C  (2  x 10”*®F)  and  a possible 
temperature  gain  or  loss  of  half  this  amount  from  inlet  to  outlet.  These  two 
error  sources  may  be  correlated  and  hence  are  assumed  to  be  additive  rather 
than  independent.  The  estimated  value  for.  spindle  growth,  due  to  heat 
generated  during  operation,  is  based  on  extensive  oonpu ter  calculations  of  an 
internal  forced-air  cooling  system.  The  workpiece  thermal  boundary  layer 
e^ises  from  the  fact  that  most  of  the  energy  expended  in  rotating  the 
workpiece  in  the  sea  of  air  around  the  machine  is  dissipated  in  a thin  layer 
at  the  workpiece  surface,  which  becomes  significant  for  the  case  shown  of  a 
1.5-ra  diameter  rotating  at  100  rpm. 

The  source  of  error  associated  with  the  spindle  air  supply  is  the  same  as 
in  the  preceding  section  except  that  the  present  estimate  is  for  long-term 
drift.  Gravitational  loading  is  due  to  small  tilt  errors  in  the  self-leveling 
system  of  the  pneumatic  isolators,  causing  a distortion  of  the  metrology  frame 
in  the  X direction.  Barometric  pressure  effects  arise  because  of  the 
evacuated  beam  tubes;  the  tube  area  times  the  extremes  of  atmospheric  pressure 
amount  to  force  variations  of  a few  pounds  on  the  metrology  structure.  Both 
this  and  the  gravitational  load  displacement  were  calculated  from 
f inite-el«nent  models  of  the  proposed  design. 

The  final  category  of  nonmachine  errors  represents  the  area  of  divided 
responsibility  for  this  example.  One  is  the  out-of-roundness  of  the 
diamond-tool  nose;  the  error  amplitude  represents  an  accuracy  of  measuring  the 
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(a) 


Plane  mirror 
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tool  nonroundness  and  prograoning  the  tool  path  to  compensate.  The  remaining 
errors  arise  from  fixturing  distortion  and  other  forces  associated  with 
rotating  and  cutting  an  unknown  workpiece.  While  the  estimates  for  the 
workpiece  factors  are  the  largest  in  the  error  budget,  they  are  also 
considerably  smaller  than  is  presently  achieved  in  diamond  turning  practice. 

Applying  Bq.  (3)  to  the  X and  Z error  magnitudes  yields  the  values  shown 
of  about  27  nm  (1.1  uin.)  for  both  axes.  Since  the  two  values  are  nearly 
equal,  the  resultant  error  is  cnnidirectiOTal  despite  the  variations  of  the 
individual  axis  components. 

It  can  be  noted  that  the  most  stringent  goal  of  13  nm  (0.5  uin.)  rms 
was  not  achieved.  The  dominant  factors  in  the  error  budget  are  the  final 
group  of  non-machine  factors;  the  goal  could  be  reached  in  the  X direction  if 
all  factors  in  the  group  vere  reduced  to  about  10  nm  (0.4  yin).  However, 
the  gocd  could  not  be  reached  in  the  Z direction  even  if  all  of  the  nonmachine 
factors  were  zero;  further  reduction  in  the  spindle  growth  and  the  workpiece 
thermal  boundary  layer  (e.g.,  by  operating  at  very  low  spindle  rpm)  %#ould  be 
necessary. 

As  a final  observation,  it  should  be  noted  that  several  error  sources 
were  excluded  from  Table  9.14-2,  as  shown  in  Table  9.14-3.  The  first  two  are 
axis -alignment  errors  that  are  angles  rather  than  displacements  and  hence 
dependent  on  the  radial  width  of  the  workpiece  surface  of  interest.  The 
second  two  can  be  shown  to  cause  a curvature  error.  For  optical  components 
these  errors  were  judged  worthy  of  special  treatment;  in  a more  general  case 
they  would  be  included  in  Table  9.14-2. 


TABLE  9.14-3  Special  figure  errors. 


Enor  »urce 

Peak-to-waiky  amplitude 

X^xit  ■tutienest  to 

0.1  urad 

Z-txu  panUdum  to  ipindle 

O.I  und 

Tool  Mtting-X  direction 

SO  nm  (2  uin.) 

Tool  noK  radius  azc 

13  nm  (O.S  uin.) 

CCNCLUSIONS  AND  RECCMMINDATIONS  FOR  FUTURE  WORK 

An  error  budget  for  machine  tool  accuracy  subdivides  the  overall  problem 
into  a number  of  smaller  steps,  thereby  providing  a more  systematic  approach 
as  well  as  a greater  degree  of  scrutiny  of  the  various  details. 

The  example  cited  in  this  paper  is  clearly  esoteric;  a valuable  step 
would  be  the  development  of  a checklist  of  error  sources  for  more  common 
levels  of  accuracy. 

Implicit  in  the  discussion  of  errors  is  an  assumed  ability  to  measure 
them;  hence  a given  firm  interested  in  designing  to  increased  accuracy  may 
have  to  begin  by  improving  their  capability  in  machine  tool  metrology. 

The  development  presented  herein  assumes  an  rms  combinational  rule  as 
suitable.  This  work  could  be  extended  toward  applications  concerned  with  the 
worst  peak-to-valley  error  by  presenting  a method  for  calculating  the 
probability  of  reaching  increasingly  leuger  fractions  of  the  maximum  amplitude. 

Another  possible  extension  of  the  error-budget  concept  is  to  aid  in  the 
writing  of  specifications  between  buyer  and  seller  for  the  acquisition  of 
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■achine  tools.  A typical  position  taken  by  the  buyer  is  to  require  that  the 
seller  provide  a aachine  tool  capable  of  producing  one  or  aore  workpieces 
within  the  tolerances  of  the  workpiece  drawing,  placing  the  full  burden  of 
Fig.  9.14-1  on  the  seller.  The  seller  is  aore  inclined  to  agree  to  a 
perfomance  specification  that  sets  limits  on  errors  by  category  and 
directiOT,  nearer  the  center  of  Fig.  9.14-1  (positioning  accuracy, 
straightness,  squareness,  etc.).  Through  an  understanding  of  what  accuracy  is 
required  for  his  particular  class  of  workpieces,  and  application  of  the 
error-budget  approach  to  the  seller's  performance  specifications,  it  should  be 
possible  for  the  buyer  to  connect  the  two  views  quantitatively.  This  approach 
should  also  allow  a rational  comparison  between  the  performance  specifications 
of  competing  sellers. 

It  should  be  e]q)haaized  that  significant  reductions  in  the  requirements 
for  machine  tool  accuracy  can  arise  from  examining  the  geometry  of  the  class 
of  workpieces  to  be  machined.  For  example,  in  machining  optical  components 
(such  as  parabolic  mirrors) , two  factors  aie  significant.  First,  the 
sensitivity  to  errors  in  the  radial  (X)  direction  is  proportion2il  to  the 
"speed”  of  the  optic,  and  is  an  order  of  magnitude  smeLller  than  the  axial  (Z) 
sensitivity  at  the  outer  edge  of  a moderately  fast  f/2.5  optic.  Secondly,  a 
nuBber  of  sources  lead  to  Z errors  that  vary  linearly  with  X (spindle 
squareness  to  X,  Z lead  error  in  positioning,  radi^Ll  toolsetting  error  (to 
first  order),  the  line^  portion  of  axial  spindle  growth  with  time  (if 
constant  rpm  and  feedrate  are  used)).  For  optical  components , the  effect  of 
linear  error  terms  can  be  significantly  reduced  by  selecting  another  best-fit 
curvature  and  making  a anall  compensating  adjustment  in  the  axial  mounting 
position.  Since  the  commercialization  of  machined  optics  in  the  infrared 
region  is  underway,  a study  which  quantifies  these  reduced  error  sensitivities 
for  optical  %rorkpieces  would  be  valuable. 
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